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ABSTBACT 

Presented is the fourth in a series o 
evaluation reports on "Me and My Environment", a 3-ye 
sciences program fo'r 13- to 16*ye^r-old educable roent 
(EMH) children. The rationale and standards for monit 
instructional, effectiveness are explained, and studen 
reported on i3.eld Ijests of items assessing instxdctio 
("Exploring My Environment"), 2 ("Me as a Habitat"), 
Belationships in My Environment") . Described is a sma 
test in which techniques of observing, describing, co 
ordering objects were taught .to 1U EMH students throu 
stereograms and viewei^ Discussed are the implicatio 
curriculum development, of a surV^ of 235 EMH adolesc 
their attitudes toward and usfe of tobacco^ alcohol, a 
drugs. Four ^abstracts of Studies oh the functional ab 
students are provided, and comments are offered relat 
about cognitive abilities and students' manipulative 
curriculum* development . (LH) 
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ME AN0 MY ENVIRONMENT is a three year environmental 
sciences prbgram developed specifically for 1 3 to 1 6 year-old 
'educable niontally handicapped (EMH) children ' Its develop- 
ment and absessmont, the actual materials and their use in the 
classroom, ithe approaches to data collection, pnd the student 
outcomes (jw ment evaluotive study Such activities might best 
be viewed! in the context of the three-year timeline for the 
development, testing, and final commercial re4ease of the first . 
two-year Sequence (Units 1-3) of the program During thjs 
period the/third-year (Units 4 and 5) sequence was de^Jeloped 
and testejd With an additional year and one-half devoted to the 
final evoluat^jon and revision for commercial release 

So that ME AND MY ENVIRQNMENT could be used m 
special education classes as soon as possible, the field trials 
were desigrfed to overlap, two complete field tests of the 
materials were accomplished in three school year-s 

The materials for ME AND MY ENVIRONMfNf include a 
series of teacher s manuals that suggest specific teaching 
strategies for each activity Also included is a kit of all 
equipment, media, and supplies that are required for the 
instructional program, bjut not usually available in special- 
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education classrooms. There^is no student text, for the ' 
program 1^ designed around. activities that are conducted by 
the students themselves; these activities are supported by a 
^*^aciety of -multisensory and raultimedia instructPonal 
materials, that is, materials \c a number of different media 
designed to appeal to two or more different senses of the 
students. Some of these materials/ in addition to science 
'equipment in tVie kit, consist of 35mm slides, filmstisips, 
cassette tapes, individual student worksheets, games, posters, 
study cards, wall charts, illustrated booklets, and evali/ative 
devices. The program makes use of a 35mm slide projector and 
an overhead projector. In addition, the students' direct 
involvement with a Polaroid camera and a cassette tape 
recorder hah been tested. 

Th^ serious reader of this report will likely harve reviewed, 
or have access to, the teacher's mapuals for ME AND MY 
ENVIRONMENT. For that reason, information on the 
curriculum objectives, science content, and skill development 
\hf\\\ not be described here. (Refer to the froni'material in any 
unit of the manuals for this information.) 

The development of this project and its evaluation are 
based upon thrde years of experienced in developing and fields 
testing ME NOW, a life science curriculum for 1 1 - to 1 3-year- 
old EMH children.^ The ME NOW program and the first two 
years of ME AND MY ENViRONMENrare now available in 
commercial edftions from Hubbar<J Scientific^ Company. Box 
1 05. Northbrook. Illinois 60062. Several eV^aluaiion reports on 
these programs have been prepared. (Refer to the bibliographv^ 
at the end of this section.) , 

The Evaluation 

Because the evaluation effort for this program is truly 
formative — an assessment designed to direct revision— the 
information gathered is utilized by the developers whenever 
the rt)aierial that has been tested is revised. One might think, 
therefore, that there is little -point in preparing formal 
evaluation reports based on this formative data Yet the 
experience gained and some of the outcomes of th^ evaluation 
have been found to have value to other audiences. Such 
information is judged not only worth preserving, but also of a 
sufficiently general application that the timeliness of reporting 
it becomes a concern It has been decided, therefore, to issue 
this series of interim eyaluat'ion reports Sfevoral cautions to 
the reader of ihrese inlorim reports are necessary in order to 
avoid misinierpreiaiions of the findings 

1 The interim reports document results with experimental 
materials, and therefore do not present a balanc&y view of 
the program finally released for commercial publicaijon 

2 The interim reports identify changes to be made, but do not 
reflect all the changes incorporated into revised materials 

3 The interim reports do not provide a synthesis that ehables 
one to draw a balanced judgment of the entire program 
A description of the contents of the first three ME AND MY 

ENVIRONMENT reports in this series is given on page 3 of 
Fdrmotivo Evaluation Report 3 Only a limited number wore 
printed, but copies are on file at all special education 
instructional materials centers and are availablo from the 
Educational Resources Information CenlCir (E^f(-f networks 
Document Reproduction Service (EDRS) * Abstrac.^s have been 
published by the CEC Information Center in its Ca^cily as the 
ERIC Clearinghouse on Handicap^d and Gifted CViildren ^ 
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Formative Evaluation Report 4: Student Perforrpance on 
.Revised Materials, and Another Look at Student Abilities. 
This report serves four purposes: * 

1. It describes the standards for judging the success of 
. instruction and of th^ materials, and- present^ a new 

approach to the assessment of student'performance. 

2. It repprts gn student performance related to instruptioriin a 
second series of field trials of revised Units 1 , 2, and 3, and 
compares the results to those of the first trials. 

3. It analyzes the rerationship' of measured abilities, per- 
formance, and various other vari&bles utilizing the techni- 
ques of multiple regression. 

4. It draws attention to certain implications of these findings 
for special education. ■ 

'ME AND MY ENVIRONMENT (Life Sciences: A Specie/ 
Education Program). Unit 1: Exploring My Environment, . 
Boulder, Colorado: Biological Sciences Curriculum Study. 
1974. 

. Unit 2: M^ as an Environment. Boulder, Colorado: 

Biological Sciences Curriculuiin Study. 1974. 

— . Unit 3: Energy Relationships in. My Environment 

Boulder, Colorado: Biological Sciences Curriculum Study. 
1975. ' 

. Unit 4: Transfer and Cycling of Materials in My 

Eri^ironment. Boulder, Colorado:* Biological Sci6r>ces 
Curriculum Study. 1973 (Second Experimental Edition). 

Unit 5: Air and Water in Mf Environment. Boulder. 

Colorado: Biological Sciences Curriculum Study. 1973 
(Second Experimental Edition). 

Wf* NO^, Life Sciences: A Special Education Program. 
Boulder, Colorado: Biological Sciences Curriculum Study 
1972 

^Robinson. James T and Richard R. Tolman. A Forepative 
Evaluation of ME NOW, Unit 1, Digestion and Circulation. 
Moulder, Colorado: Biological Sciences Curriculum Study/ 
September 1970 97 pp (ED 043182) (EC 030165) 

Steele. Joe M Arranging Field Tests: Characteristics of Sites 
and Students. ME AND MY ENVIRONMENT Formative 
Evaluation Report 1 Boulder. Colorado Biological Sciences 
Curricu^utn Study June 1973 29 pp (ED 087190) 
(Et 061292) 

Assessing Student Abilities and Performance Year J 

ME AND MY ENVIRONMEN T Formative E valuation Report 2. 
Boulder, Colorado Biological Sciences Curriculum Study 
Decernber 1973 48 pp"' (ED 0871 91 ) (EC 061 293) 

Design and Revision. Da{,a' Collection and Portrayal 

ME AND MY ENVIRONfyiENT Formative Evaluation Report 3 
Boulder, Colorado Biological Sciences Cur/iculum Study 
September 1>74 53 4)p (ED 1001 23) (EC 071063) 

Tolman, Richard R A Formative Evaluation of ME NOW. Life 
Sciences for the' E due able Mentally Handicapped. Final 
Report Boulder, Colorado Biological S(!:iences Curriculum 
'study December 1972 305 pp (ED 071 263) |EC 050871) 

^ERIC Document Reproduction Service, P 0 Box 190. 
Arlington, Virginia 22210 

'^CEC Information Center. 1920 Association Drive. Reston, 
Virginia 22091 

t; 
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a revised means 
of monitoring 
the effectiveness 
of instructioTT 
(clues to success: 
rationale 

d standards) ^ 




Research studies have established that teacher expectancy 
directly affects studem achieverrient, not only in classes for the 
educable mentally handicapped (EMH), but in almost all other 
classes as well. Because teacher expectancy has quite often 
been low for EMH students, and because teaching rriaterials in 
science have no traditional or essential place m tjie curricula 
for these students, designing test items that field-test teachers 
could administer to their classes with confidence became a 
special problem to the curriculum developers. 

It had been demonstrated during the formative evaluation 
of ME NOW that EMH children could respond appropriately to 
four choices in a pictorial format that contained a minimum of 
written material. The design and many examples^^such items 
were elaborated in Formative Evaluation Report 2, eHong with 
the background of their development and the data tntot were 
obtaine^J from thrfr trial use. For Field Test I the items were 
grouped in identical pre- and posttests. for administration 
procodmg and following eaOh unit of instruction. Included m 
each tost wore items specifically designed to secure mforma* 
tlon on student baseline knowledge, inquiry s|glls. problem- 
.solving ability, functional ability, ^nd understanding of 
environmental themes. ' Th^ items were also designed to 
sociiro data about how successful the students had been in 
achieving obfoctivos. and yvhot their interest level had been 
Procedures wore devised to assure that students were not 
ponolizod for roodlng difficulties the items were read to them 
by thoir toochorB as they followed along in their test item 
booklot^8> ond mpoouroB wore included to make sure that all 
students were attending to the same to&4 item at a given time 
during'adminlstrotion of the test This is a departure from what 
vyas done during the ovoluatlon of ME NOW where, in addition 
to the above", each question was duplicated on a 35mm slide 
and projected on a screen during the lost for added reference 
The items were not intended 08 tests for grading, nor we're they 
used that way to ovoluato youngsters 

The use of pro- and poflltootmg in a formal achievement 
testing framework provided' considoroblo information, as 
Formative Evqiuatton Report 2 mdicmoo This testing format, 
however, proved to be of little voluo loTho writers who revised 
the materials, for a relatively smoll number of items wore tied 
to indlvlcjual activities; most wore lied to largo sequences of 
insirudtton. Injaddilion. the items wore costly to develop, time- 
consuming to analyze, and results wore often incomplolo at 



the tim^ revision took place. For these reasons, therefore, and 
because baseline data on the students and their functional 
abilities had been obtained in the^first year of field-testing, a 
different format was planned for obtaining perforrpance data 
in the second year — a format that would serve both the needs 
of the current formative evaluation, as well as those. of the 
teacher, once the program became co^nmercial 

Thus, m the fall of 1972. with the first field'test 'of the 
second edition of Unit 2. "Me as a Habitat/' a nurriber of 
situational tasks and mmitests were incorporated into the 
Teacher's Instructional Manual. These were designed to 
provide immediate feedback on student understanding as well 
as on the effectiveness of materials and instruction. At 
whatever point in the curriculum each of those activities was 
used, teachers would have the opportunity to determine 
whether their students were ready for the next activity, or 
whether modification, repetition, extension, or review of 
certain activities was necessary before proceeding These 
short evaluative activities vyere also useful to the project staff 
in providing feedback directly related to specific activities. This 
valuable data was used in making specific recommendations 
for the revision of activities, cores, and units 

The pilot test of the newapproach was judged successful It 
was consequently decided to drop the achievement test pre- 
and posttosi format Instead, for Fiold Tost II. data was 
collected at the timo or shortly after the concepts were taught. 
Instructional assessments wore developed for short se- 
quences of activities throughout Iho entire set of ^rricular 
materials These assessments were developed as activities in 
themselves, and in many cases they ' involve practical 
applications or actual performance tasks rated by the teacher. 
They include a tallysheet for compiling information on each 
student, or for making the ratings of perforrrfance Instructions 
to the teacher explain how to interpret and use the materials. 
The tallysheels. and in some coses the student worksheets 
themselves, were sent to the BSCS and used as the source of 
data on student performance ^ 

For the three units of instruction that h^ve so far been 
released for publication, nearly 100 assessment items were 
developed, three-fourths of these can be scored for individuol 
students, while the remainder are used to make judgments 
about classroom groups of students. These assessment 
activities were given the title "Clues to Success " They appear 
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periodically aft6r a cluster of similar activities, at the end of 
each core of a unit, and as summarizing or review activities at 
the conclusion of each unit. An effort has been made to 
present them to the teacher as a means of determining which 
students are successful with the materials and ready to 
proceed to the next' level of instruction and which students 
have not met the minimum criteria and therefore need 
additional help. They are not presented as a way of grading the 
students. It is felt that the assessment-activities reinforce a 
student success syhcjrome. ^ 

The^data collected from "Clues to Success * did in fact 
provide the revision team of writers with'specific performance 
information related to each activity or small cluster of 
activities. Also, as indicated in teacher feedback reports, the 
assessment activities were of graat value in guidmg teachers 
in planning and monitoring instruction, both for the entire 
class and for individual students. From that ^ata andfeedback, 
it has been concluded that changing from the pre- and posttest 
format used in FieUd Test I significantly improved the quality of 
the materials. The "Clues tO\Success" format that was used irf 
Field Test II was, however, a major .departure from the 
evaluation technique used in fie\6 Test I. TheVe were, as a 
result, a number of trade-offs of data, both qualitatively and 
quantitativelV It is acknowledged that the "Clues to Success" 
assessment activities that .were used in Field Test II have 
certain shortcopnmgs'asan evaluative device: 

1 They do not provide data on the long-term relenlipn of 
knowledge and understanding. Since the "Clues to 
Success" activities were interspersed as they were, soon^ 
following instruction, they became an immediate check on 
knowledge and und^rslanding, but not a long-term one 

> 

2 They do not make data collection s.imple-and easy Because 
data is collected at many points throughout the school year 
rather than at the beginning and end, a host of problems are 
created The most signficant of these are student 
absenteeism, less control over testing conditions, and, a 
potential deviation from uniformity because fhe scoring 
and coding is done by the teachers themselves 



However, the "Clues to Success" short-term assessment 
\ierj)s used in Field Test II and the commercially published' 
editiops pfovidethe following advantages; 

1 . Immediate f-eedback on the effectiveness of the materials 
and instruction. At the point of use of each of the "Clues to 
Success" activities, the teacher can determine whether or 
not his or her students are ready for the next activity, or 
whether modification, repetition, extension, or review of 
certain activitiesjs necessary before proceeding. 

2. Assessment directly related to specific activities. Valuable 
feedback and recommendations *for revisions of activities, 
cores, and units are thus available. 

3 Opportunities for the teacher to monitor the individual 
progress of each student and set different standards of 
success for deferent youngsters. Because some 
youngsters may do well in some units and not so well in 
others, the "Clues to Success" enable the teacher to adjust 
assessments of each student as the year goes on. 

Standards for acceptable student performance were 
established by BSCS staff members and evaluators on the 
"Clue's to Success" objective questions and situational tasks. 
It should be noted that these standards were not attempts to 
predict actual performance on the items In fact, quite the 
contrary. The staff worked hard to assUre that expected 
outcome^' would not be a basis for establishing standards. 
Instead, two questions were continually asked: "How central 
IS this particular item or subtest of items to the major goals, 
aims, and objectives of the ME AND* MY. ENVIRONMENT 
cJrficuJum materials?" and, "What level of performance, in 
terms of percentage of studepts responding correctly on the 
items, can we accept as not requiring revision of th0 activities 
inv5lved?" Because individual Assessment items were includ- 
ed in the "Clues to Success" for a number of reasons, the 
spectrum of standards rUnges from 85 percent for the more 
central ones to a low of 25 percent for those less central Some 
assessment items were aimed at securing data to determine 
directly the effects of the materials and/or instruction, while 
other Items were aimed at finding out how much more beyond 
certain basic levels students had been able to leorn ■ 



Summary of ME AND MY ENVIRONMENT Editions Correlated with Field Tests 



First Experimental Edition 



UNIT 1 Uniilled(1971-72, FieldTestI) 

UMIT 2 Part 2,' Untitled (1971-72, Not 
field tested) . 

UNIT 2 Part 1, Untitled (1971-72. 
Ffold Test I) 



UNIT 4 Transfer and Cycling of 
Materials m My Environment 
(1972 73, Field Test I). 

UNIT 5 Air and Wgter in My Environ 
ment (1973-74, Field Test I) 



Second Experimental Edition 



UNIT 1 Exploring My Environment 
• (1972-73, Field Test II) 

UNIT 2 Me as a Habitat (1972-73, 
Field Tests I and II) 

« 

UNIT 3 Energy Relationships in My 

Environment (1972-73. Field 

Test II) 
•v 

UNIT 4 Transfer and Cycling of 
Materials in My Environment 
(1973-74, Field Test II) 

Nooe > r 



Commercial (Final) Edition 



UNIT 1 Exploring My Environment, 
1974 

UNIT 2 Me as an Environment, 1974 

UNIT 3 Energy Relationships in My 
Environment. 1 975 



UNIT 4 Transfer and Cycling of 
Materials in My Environment. 
1976 

UNIT 5 \A/ater and Air in My Environ- 
ment. 1976 
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student performance 
on items assessing 
instruction in unit 1, 
"exploring my 
environment/" 
field test II ( 

For Field Test II. sixty-two items assessed curficular 
materials and instruction in the seventy-lhfee activities of Unit 
1 , "Exploring My Environment." Unit 3. ":Ertergy Relationships 
in My Environment." (revised from Unil^, part 1 . 1 971 -72 first 
experimental edition), and Unit 2. "Me a' Habitat." (revised 
from Unit 2. part 2. 1971-72 fiVst experimental edition). 

While Field Test I data were collected on identical pre- and 
posttests and administered preceding &0d following each unit 
of instruction. Field Test II data were doliected from "Clues to 
Success" activities that were incorporated in each unit and 
administered at various intervals Immediately following 
instruction. ' . 

The population from which data were analyzed for Field 
Tpst II consisted of seventeen clissejs containing 197 EMH 
students. On some subtests. hoy^V^r, because af student 
absenteeism in some cases and* disqualification pf dafa in 
. others, the population wa^-considerably less than \97.yData 
was disqualified when in the judgment of the BSCS' staff it 
appeared thai certain teachers provided too much direction to 
their students, and as a result. Qqarly every studeht responded 
-^to ihe-assessments m the sanrie way. 

Twenty-two of the sixty-lwo it'oms directly related to 
materials and instruction in Unit 1. The twenty-two items 
assessed materials and instruction presented in the twenty- 
nine activities of the revised unit, and the items fell into six 
categories by topic: 1) Environmental Comparisons; 2) 
Temperature. Estimation..and Measurement; 3) Grouping and 
Classifying; 4) Spatial Orientation. 5) Specific Information. 6) 
Picture Taking. Although the results are presented by these 
content topics, the items were interpreted separately rather 
than as subtest scores 

Resultstire presented with a brief discussion of each item, 
percentages of students responding successfully, com- 
parisons to establish' standards as discussed in "Clues to 
Success." where possible and appropriate, comparisons to 
■ similar or identical assessments made in Field Test I. and a 
brief analysis and explanation of revisions and expansions 
and/or deletions that took place in the commercial version as a 
result of student performance on these assessments In 
addition, there is discussion on twelve assessment items given 
to students at least three months after i^truction on Unit 1 to 
measure long-term retention 

The percentage of successful responses on the earlier ME 
' NOW lest items was characteristically at the 50 percent level 
I In that study many students had reasonable and logical 



explanations for choosing options other than the intended 
answers to many items; hence, the level of understanding was 
not totally reflected in the percentage of students choosing the 
"right" answer. A sirrjilar condition also has occurred in the^ 
ME AND MY ENVIRONMENT assessment. In fact. 40 percent 
of the Ur^it 1 test items have a qualitative scoring key, with 
some responses.given credit as partially correct. The reasons 
for choosing other 'tinswers" provide a separate justification 
for inspecting each item separately. ' ^ 

The problem of assessing the learning of EMH students id 
not resolved by producing an "achievement test." since the 
question of what standard to apply to performance on these 
items or subtests is one that is difficult to answer. It is ^ 
unrealistic to expect all children to be able to answerall items, 
when a wide range of difficulty and a range of topics are 
involved. Answering successfully even one or two items more 
on Field Test II than on Field Test I may represent considerably 
improved materials and. therefore, significantly more learning 
for some students. The items represent thestaff's judgment of 
key content that should be learned, not all learrfing that can be 

> expected to occur in instruction. Some areas of learning were 
not assessed at all; others were explored only through 
interviews and are not reported here. Notably absent are 
measures of observation skills and problem-solving skills that 
are directly related to the materials. Students' attitudes also 
are'' not reflec;ed here, although measures are reported 
elsewhere. The effects of this curriculum on self-confidence, 
social participation. taSk orientation, and general response to 
school have not been formally assessed. 

Efforts were made from the beginning to assure that use of 
the Items in different classes would be comparable. The 
"Clues to Success" activities were administered by the 

' teachers, using identical instruction^. Some training was 
provided at the beginning of the school year, and additional 
written instructions were sent. Even with these precaiitions. 
however, conditions and procedures could not be 
standardized. 

The test items themselves were undergoing their second 
field test Individual interviews with students were conducted 
to validate certain itenns. and. as a» result, approximately 30 
percent Of the original number of items were eliminated t)r 
Significantly revised Undiscovered weaknesses may remair^ 
in some of the twenty-two items retained for analysis. 

It should be noted that student performance on these 
selected assessments was only one vehicle used in evaluating 
the ME AND MY ENVIRONMENT curriculum materials. 
Student interviews, teacher ratings, independent evaluotors. 
and classroom observations were all used extensively to« 
provide additional input to the curriculum developers 

However, these test items do represent the best judgment 
of the staff as to key concepts to be learned in the materials 
Even though the results should not be used as a summative 
evaluation of student learning, they do provide a clue to the 
degree of learning that occurred. Combined with the informa- | 
Jion on the functional abilities of this population, expectations 
of student response can be readjusted, and revistonsdesigned 
to enhance further learning. 

Prior to field-testing, the staff established standards of 
acceptable student perfortnance for the various objectives and i 
assessments In some cases these standards were basec^on 
hard data, but often they were intuitively based on such factors 
as a general knowledge of the popu^lation, th& importance of 



the item, and the experience of a normal population of 
, students with similar it^ms. 

Some of the items assess learning that goes beyond the 
achievement of minimal objectives. Since the curricgjum is 
designed to allow , the students in a typical EMH group, to 
progress as far beyond the minimal standards as possible, 
some items were meant \o assess what learning took place 
above the minimum. Hence the performance standards do vary- 
from 25 percent up to 90 percent. Upon studyifig the reliability 
and other analysis factors of the items, the staff.compared the 
standard to the actual a(!!hievement and sought answers to the 
questions raised by proceeding in at least one of four ways: to 
analyze the item for clarity or unwanted cues; to relate the item 
to instruction; to look at the instruction related to the objective; 



tp look at the objective itself« Based upon this introspection, the 
standard- was deemed realistic or unrealistic, instruction 
adequate or inadequate., or the objective appropriate or 
inappropriate. 

The staff found it of interest that '\r\ eighteen of the twenty- 
three cases in the second experimental edition of Unit 1 . (Field 
Tesfll) the students did achieve at or above tne standard. Of the 
fourteen similar but not necessarily idemipal items in the first 
experimental edition of Unit 1 (pMel^fi^est I) all but two were 
lower than the results of Field TQSt II. This reflects an 
improvement in the materials as well as in thtf items between 
the two'field tests. 

A summary of results from the use of the tQSt items follows. 
'(See Figure 1 .) 



FIGURE 1 



A Comparison of Staff Stondorda of Achievement in Unit 1 with 
Actual Results in Field Tests I and II 



Staff Standard 



Fiald Tait M 

Fiald Tqtt I 




1 ,1 1 2 all 1 2 13 2 1 



Unit 1, Subtest 1, "Environmental Conn- 
pf^risons" 

Table 1 contains a statistical summary of three assessment 
Kems used as Subtest 1. "Envir6nmental Compa{;isons." 
These' assessments were admmistered as Activity 1-12 on 
Tallysheet 1-1 in Core.A. Unit 1. "Exploring My Environment." 
second efxperimental dfeition. 1972-73. Table 1 includes item 
assessmeri\ objectives, item scoring, and other subtest 
statistics. The maximum score for this subtest was seventeen' 

, points; four|)oints for assessment 1. eight for assessment 2. 

* &nd five for 'assessment 3' 

Assessment Y deals with the relationship between our 

. senses and the environment about us The data reveals that 79 
percent of the students responded successfully to the items, 
compared to the BSCS staff standard of acceptability of 80 
pprcent. Statistically. 79 percent is within the acceptable 



TABLE 1 

Summary Informotion for Subtest 1 
"Environmental Comparisons" 
(throe ftomal 
This oroup^f Items assessed ability to 

• identify which of the senses respond to specific onvironmontal 
stimuli {Item 1 ) . 

• recognize that a variety of concrete and intangible elements can 
form port of the environment (Item 2|' 

• understand the relationship between an animol and its environ- 
ment (Item 3) 

* Subtest Weighted Scores 
Weights Per Option 



Item 


A 


B 


C 


D 


E 


F 


G 


H 


1 - 

2 

3 


0 
' 1 
0 


0 
1 

5 


0 

1 

0 


f 

0 


1 

0 




1 


1 



Subtest Statistics 
Moximum Possible Score 17 
Range of Scores 3-17 
Number of Students. 144 
Mean 9 



o 

ERIC 



40 



7 



range. Inthe identical assessment that was used in Field Test I, 
84 percerit of the students responded successfully, slightly 
above the acceptable standard. 



1-1. 

SJbv'V Im( fOLLOWlNG-JJM 

FIRt SlklN ^ 
TRAIN ►iHrJLl 
JLI AIHPLANt 
ROCK MU':,lt ' 
'A^\ >HORl 



rfMllM Mil bi'J HHP you 11 IL IF All OF M'A ^im 
PARI m <OUR INVIR0NM{NP 

/-J 





4%» 

Mul^tiple Response = 4% 



f 

7% 



79% 



No Response = 21% 



♦ Assessment 2 measures student recognition of» some 
components of the environment All eight choices are correct, 
aod 28 percent of the students successfully selected all eight 
Four or more of the responses were selected by 60 percent of 
the students BSCS staff standards were for 25 percent of the 
students to select all and 90 percent to select four or more of 
the choices This same question was used in Field Test 1. but 
with fourteen choices instead of eight The choices were 
reduced by six in Field Test 11 in order to correlate more closely 
Cvilh the instructional materials 'In Field Test 1, 24 percent of 
the students selected all of the correct responses anc| ,78 
percent selected four or roore Overall student performance on 
this assessment was better in Field Test 1 than m Field Test 11 



12. 

(Refer to Item 13, page 3b,.Formattvo 
E valuation Report 2) 



".Apt M\ t iU 



60% 



67% 



65% 69% 



1 1 f'MtPii |f 'I'M,: 
75% 59% 

No Response = 4% 



76% 



AN* 



58% 



Assessment 3 asks students to select an animal as a poster 
theme and to include in the poster the environmental 
components that are important to the animal's well-being. An 
accurate understanding of the relationship between an animal 
and Its environment with a listing of five key components (food, 
shelter, etc.) essential to the animal's environment was, 
demonstrated by 39 percent of the students. Thirty percent of 
the students were able to select three or four essential 
cdpnponents. and 31 percent - selected only one or two 
components. The selection of' three or more essential 
components by 66 percent of the students was set as a 
■ standard by the BSCS staff Student performance slightly 
exceeded this standard. There was no appropriate assessment 
for comparison in Field Test 1. 

In referring to the table on page 26 o\ Formative Evaluation 
Report 3, it can be seen that the activities in Unit 1 vJore 
con^derably revised before the unit was released for 
cd^mmercial publication. To mention only a few of the more 
extensive revisions, the environmental activities were moved 
to Core C so that more science would be presented before 
environmental relationships were introduced, the En- 
vironmental Rummy game was expanded, improved, 
presented in 1our-color art, and offered in smaller sequential 
steps 

Unit 1, Subtest 2, "Temperature, Estimation 
and Measurement" 

\able 2 contains a statistical summary of six assessment 
Items used as Subtest 2. "Temperature. Estimation and 
Measurement These questions were administered as 
Activities 1-20. 1-21. and 1-22 on Worksheet MO and 
Tallysheet 1 -3 in Core 8. Unit 1 . "Exploring My Environment." 
second expenmental edition. 1972-73 Table 2 includes item 
assessment objectives, item scoring, and other subtest 
statistics Th^ maximum score for this subtest was twenty-two 
points, five points each for assessments 1.2.5. and 6. and one 
each for assessments 3 and 4 

Assessment 1 measures student ability to read within 
t 2° F a thermometer placed m a beaker of water The 



TABLE 2 

Summory Information for Sublos! 2 
Tomporoturo, Eolimotion and MooBuromoni 
(six iloms) 

This group of MomB aftsu&sud flbihly lo ' ^ ^ 

• rood n ihorrpomotor (Itom 1) . 

• d»fforon!in!0 botwoon groups of lompor niuroti inkon indoorsjnnd 
-outdoors (Itom 2) 

• oBtimolo iQngih (horns 3 & 4) 

• monsuro lOpQlM nccurntoly (Iloms 6 & 6) 

Subtest Woightod Scoros 
Weights Per Option 



Itom 


A 


B 


c 


D 


E 


F 


Q 


1 


5 


0 










> 


2 


5 


0 












3 


1 


0 


0 


' 0 


0 


0 


0 


• 4 


1 


0 


0 


0 


0 


0 


0 


5 


5 


0 


JO 


0 


0 


0 


0 


6 


5 ^ 


0 


0 


0 


0 


0 


0 



Subiosi Sintistics 
Mnximurn Ponaihln Scorn 22 
Rongo of Sco>ob 2-22 
Numbor of Sludonis 143 
Monn 12 



ERIC 



1i 



thermomeier vyas shifted between beakers containl'ng water 
at varying tempe'ratures to prevent students from exchanging 
Information^Results show 89 percent of the students were 
successful on this item, compared to a 56 percent stqndard of 
acceptability In Field Test I. 75 percent of the students were 
Successful with the activity It is iryere^ting tp note that EMH 
students compared most favorably with "average" youngsters 
on this assessment. 

Assessment 2 evaluates , student ability to differentiate 
1)etween two groups of temperatures^MDne group taken inside 
and one outside.* Results indicated that 67 percent of the 
students responded successfully, compared to the^^&D^qprcent 
staff-established standard. An item assessing the same 
objective, but by means of a line graph instead of a table, was 
used in Field Test I. where 65 percent of the students 
responded successfully 

22. 

(Refer to Item 20. page 33. Formative 
EvoluQtion Report 2) 

!N A m IN Twn JfMi'fNl fl/Mi '. " 'U\ Inj ii-^l'i*.,; 

llflPLRATuRt IN A LUV/.f'Oa*^ 



A 
67% 



B 

30% 



fWRh AH X ON TmI PdORU ImAI THt l|MP|l.Al .^t 

Multiple Response = 2% No Rating = 1% 

Assessments 3 and 4 tost student ability to estimate the 
length of two pieces of paper stf ips. one measuring 3'/j inches 
and the other 1 8 inches The students who estimated the 3Vj. 
inch strip to be between 1 inch i)nd 6 inches in length 
constituted 84 percent of those tested Of those. 79 percent 
estimoiod it to be between 3 and 4 inches The staff had 
established a standard of 40 percent within the 1 inch and 6- 
inch range The students whoestimated the 1 8-mch strip tobe 
between 12 inches and 24 inches m length constituted 61 
percent In this case, the staff had ostablishodil standard of 25 
percent In Field Test I. an estimation assossm^mt asked 
students to predict how many paces were in 1 0 foot Loss than 
20 percent otthe students responded successfully In another 
assessment students were dsked to guess and then try to 
determine the distance between^ two points 15 feet apart 
Thirty-one percent were successful at this 

2-3 and 2-4. 

(Refer ^o Items 7, 41. and 42. page 2^ , Formative 
Evaluation Report 2) 

IjuC/. TH( IIN(,1M Of iMf.'.HOM ANI; IfjNfr IH'" )l '"AIM 
MY GUtVr 1H(hI'. . inW',. ' \hi>^[',. 



Assessments 6 and 6* test student ability to measure 
accurately within V* inch the 3V2-inch and 18-inch strips of 
paper. Over 66 percertt of the students were successful with 
the 3V2-in<^h measurement, and 47 percent were successful 
with the 18-inch measurement. The standard for this 
assessment was that 50 percent of the students should 6e able 
to measure' both lengths accurately. In Field Test I, the 
measurement assessments were three in number Students 
were to measure objects and ^Jistances superimposed on a 
grid, given the grid dimensions and scale. Almost 35 percent o| 
the students measured accuraiely 

2-5 and 2-6. 

(Refer to ltemd'12, 16. and 23. page 31. Formative 
Evaluation Report 2) 



lT,! YOUP RULLR to fllASURl THl UNGlH Of U\\ >HORT ANU 
lONb OF PAPtP. WPlTl YOUR ANSwl R'. KY I Ml P|CJUR{ 

Of Int PUlfP ON Tm| LINI'. BUUW.' 

',M0R1 JPiP - lONO '.TRIP 



As can be seen from the data.XField Test II student 
performance for this subtest significantly exceeded both staff- 
established standards and the student performance in Field 
Test I on identical or similar items There was some revision 
and rearrangerpent of the activities that are represented in thip 
subtest, but generally it was felt that the materials were 
successful and should be retained in the commercial edition 

Unit 1,. Subtest 3, "Grouping and Classify- 
ing" 

Table 3 contains a statistical summary of six assessments 
used as Subtest 3. "Grouping and Classifying " These 
assessments were administered as Activities 1 • 15. 117. and 
1 -22 on Worksheets 1 -9 and 1 - 1 0in Core B. Unit 1. 'Exploring 
My Environment." second experimental edition. 1972^73 

1 TABLE 3 

Summory Informnlton for Subtest 3 
Grouptng nnd Cin9flify»ng 
(six Homo) 

ThiB aroup of iloms n&ooaaod nbiliiy to 

• difToronlinto bolwoon plnnia nnd nnimnia (Itom 1 1 

• follow diroctrqnfi (llom 2) 

• compltJlo n IflFik (Horn 3) 

• diffofonlmlo bolwoon nonliving Ihings plonm. nnd nnifnolB |llom4) 

• differ ohtinio (hsi. cnlogorifo) chnrnciGritilic» of living things (Horn B) 

• dolormmo by whol cnionn two groups of ob)oct8 worn cntogori/od 
(llGm 6) 

Subtest Weighted Scores 
Weights Per Option 



Itom 


a; 


B 


c 


D 


E 


F 


0 






0 








0 


0 






0 








0 


0 


3 


i 


0 








0 


0 






0 








0 


0 




^ 3 


0 


5 


0 


0 


0 


0 ' 


8 / 


5 


0 


0 


0 


0 


0 


0 



Subtoni Sintistics 
Mnxirnum Po»sihle Scorjn 30 
Rnnge of Scoren 0 30 
Number of Studenia 144 
Menn 16 



t 1^ 



ERLC 



Table 3 incj'udfes item assessment objectives, item scoring, and 
other subtest statistics. The maximum score for this subtest 
was thirty ppints, five points for each of six assessments; a 
possible^ three points of^partial credit could be ea^^ed for 
assessment 5,. " * 

Assessment 1 measures student ability to sort and group 
ten pictures into two categories, plant and animal. Almost 91 
percent of tiae students were successful|comp3r6dtothe staff 
standard oif 80 percent. No item in Field Test I could be used 
appropriately for comparison. 




less accurate but still acceptable choice. The. staff had 
determined that a successful response by. 70 percent of the 
students w^s an acceptable' standard. There\was no ap- 
propriate assessment item in Field Test I for corpparison. 

Assessment 6 measures student ability to determine by 
what criterja two groups of objects had been categorized and 
separated. Over 68 percent of the students were successful in 
jdetermining that. the criteria vyere "living" and t'^nonliying." 
The startdjard for this assessment wa^s that 80 percent of the 
students should be successful. A similar assessment was also 
used in Field Test I, where 52 percent of- the students 
responded successfully.'' ' ^ 

(Refer to Item 24, page 35, Formative ^ 
Evaluation Report 2) ^ 

vLOOK AT THE TWO GROUPS OF OBJECTS. . ' - 



GROUP I 



GROUP II U 






Assessments 2, 3, and 4 are relate;! to a, class pond project. 
Students made a list of everything contained in the pond, then 
sorted the items on theirJists into three categorfes: njever lived, 
plants, and animlls. Evaluations. of the students were made in 
three areas, following directipns, completion of the task, and 
accuracy in sor^fpg, the pond items. Over 95 percent of 'the 
students follovSred directions successfully, 94 percent com- 
pleted the task, and 54 percent sorted the items coppectly. Staff 
standards for this activity were that 66 percerU:df the studente 
shoulid perform all three tasks successfu^j^ There were no 
appropriate items in Field Test I for conyarispn. 

Assessment 5 rfieasures studen>^bility to redall and 
understand characteristics of lM»g*fhings. Mercury in dilute 
nitric acid solution sprinkled with, potassium dichroijnate 
crystals provides an illusion of liyt^^p^aracteristics — mobility, 
reproduction, and color change. Several days after the 
students watched this demonstration, they were asked which 
of fdur statements best described what happened to the 
mercury in the dish. Successfuf responses were recorded for 
52 per cent of the students. Another 7 percent responded to a 

3-5. 

YOU SAW SOMETHING MOV I NQ. IN A PETRI DISH THAT WE PRO- 
JECTED ON A SCREEN. '.THE THING JHAT MOVED^WAS MERCURY. 
WHICH SENTENCE BEST DESCRIBES THE MERCURY? MARK AN X ON 



WHICH WllRD PAIR BEST TELLS HOW tHE OBJECTS WERE PUT INTO 
THESE TWO GROUPS? 



68% 
10% 



A. LiVlNG-NOFitlVING 



C. HARD-SOFT 



10% 



MOVE-DON 'T MOVE 



D, WET-DRY 



4% 



MARK AN X ON YOUjl CHOICE. 



YOUR 


CHOICE. 


A. 


IT WAS DEAD. 




B. IT WAS ALIVE. 






IT NEVER^tD. 


D. 


"it WAS E/TTING. 



7% Multiple Response = 2% 
No Response - 2% 

22% 
52% 
15% 



Multiple^Response = 4% No Regp^pis^= 4% 

The data on this subtest indicates that it was more difficult 
for students to determine vvhat categories object^had already 
been placed in thian ttf place objects in previously defined 
categories. To improve student understanding of grouping and 
classifying, activities that related to these Concepts were 
expanded, revised, and rearranged from Core B in the second 
experimental edition to Core A in the commercial edition. 
Since so few classes became involved in the pond project 
(Activity 1-17 In the second expepmertfal^ edition),^ wdS 
dropped and replaced by other grKHiping and classifying 
activities (see page 26 \n Formative Evaluation Report 3 for 
details). * ' • / 

Unit 1, Subtest 4, "Spatial Orientation" 

Table 4 contains a statisticalsummary of four assessments 
used as Subtest 4, "Spatial Orientation." These assessments 
were administered as Act^ity 1 -29 on Wo|j<sheets 1 -1 2 and 1 - 
.13 in Core C, Unit 1, "Exploring My E?lvironment," second 
experimental edition, 197?-73. Table 4 includes item assess- 
ment objectives, item scoring, and other subtest ttatistics. The 
maximum score for this subtest was eighteen points — five 
points each for assessments 1, 2, and 3, and three points for 
assessment 4, with partial credit given for assessment 1 . 



TABLE 4 

Summary Information for Subtest 4 
/ "Spatial Orientation" 
' {four items) • ' 

This group of items' rneasu red ability to 

• determine compass directions and orientation in relation to 
directions oa a map {Item 1 ) ' 

• locate the intersection of two streets on a- map '(Item 2) 
dfetermine cpjppass directions on a map (Item 3) 

• locate compass direction from the sun's position (Item 4) * 

. Subtest Weighted Scores: 
! Weights'Pe,|; Option* 



Item 


A 


8 


C 


D 


A f 

X 


1 


3 


' 5 


0 


i \. 


. 0 


■ 5 


-0 


0 


3 


5' 


0 


0 


0 




0 


3 


0 


0 



, ^ Subtest Statistics: 

Maximum f^ossible ScQre: 18 ' 
Range of Scores: 0-18 
Number of Students: 115 
Mean: 13 



Assessment 1 measures student ability to determine map 
directions after "nortli" was given. Approximately 66 percent 
of the students responded successfully to all parts (three)^of ^ 
th6 question, 1 p ercent responded successfully to two parts, 3 ^ 
4-1. 

(Refer to Item 4, page 25. and Items 6 and 25, , 
page 30, Normative Evaluation Report 2) 

THE MAP BEL0W*SHOWS PART OF A CITY. NORTH IS MARKED ON 
A LINE AT THE TOP OF THE HAP. WRITE EAST, WEST, SOUTH IN fHE 
- CORRECT PLACES. ON THE OTHER THREE LINES. 

'north; 



■J 



ELM AVENUE 



OAK AVENUE X 



69% ' 



1 



PINE ^ AVENUE 



\ 88% 



4-2. 



MANUEL LIVES WHIRL FOURTH SfRLLI ANU OAk AV[NUE inO\'.. 
ON THE i^AP ABOVL, MAR'K AN X ^HLRL OAk AVLNUi iRO'- ,1'^ 

FOURTH '-TREET.^ 70% Correctly 
30% Incorrectly 

4-3. 

flARK AN X QN THE LEFT SIDE OF THE MAP. 

percent located "west" only, 22 percent located "south" only, 
3 percent located "east" only, and 4 percent did not respond. 
The standard for this item was that 80 percent of the Students 
should respond successfully to all three directions. Student 
performance was below this standard. *A similar question was 
used as a posttest item for Field Test I, with 53 percent of the 
students responding successfully to all items. 



Assessment 2 measures student ability to mark a particular 
intersection oh a map. The results indicated that 70 percent of 
the students were able to respond successfully. This compares 
favorably with the established standard of44 percent. Only 7 
percent of the students responded successfylly to this item on 
pfeldTestl. 

Assessment 3 measures student ability to mark the left side 
o{ a map. More than 87 percent of the students w^re 
successful, compared to a slightly higher standard of 
acceptability, 90 percent. There w^sjto comparable question 
administered on Field Test I. ^' 

Assessment 4^^s stgdentabj|i|y to view a picture ofa boy 
taken in the late afternoon and f&"determlne which compass 
direction the boy is facing. Compared to an established 
Standard of 40 percent, 65 percent of the students responded 
successfully. Student performance exceeded acceptable 
standards. A similar but not identical assessment was used in 
Field Test 1 with the resultthatg4percentofthe students were 
successful. , 

4-4, 

LOOK AT THE PICTURE BELOW OF A PARK IN LATE AFTERNOON. 
' WHAT DIRECTION IS^ THE BOY LOOKING? . « 

22% 65% 6% 3% 



A. EAST 



WEST 



SOUTH 



NORTH 



MARK AN.X ON YOUR CHOICE. 



Multiple Response = 2% 
No Response = 2% 




The data on this subtest indicates that student performance 

for field Test II was improved over that of Field Test I. Because 

some scores were below the acceptable standards, however, 

and because some teacher feedback recommended certain 

changes, revision took place on those activities that related to 

spatial orientation. Refer to pagle 26 of Formative Evaluation 

Report 3 for information on specific activity revision. 
♦ * 

Unit 1, Subtest 5, ''Specific Information" 

Table 5 contains a statistical summary of two assessments 
used as Subtest5, "Specific Information. "These assessments 
were administered as Activity 1 -29 on Worksheet 1 • 1 3 in Core 
C, Unit 1, "Exploring My Environment," second experimental 
edition, 1 972-73, Jable 5 includes item assessn^ent objec- 



1/; 



11 



tives, Item scoring, and other subtest statistics. The^maximum 
score for this subtest was ten points, five for each'assisssment 
with partial credit given for assessment 2. . • 

TABLES / 

Summary Information for Subte^st 5 
"Specific-lnfarmation" ' 
f . (two items) > 

This group of , items assessed: 

• recognition of essentials for life (Item. 1) v.r 
.ability to define "recycling" ' \^ 

Subtest Weighted Scores: ' . ' 
Weights Per Option 



Item 


A 


B 


c 


D 


E 


F 


G 


H 


1 


J 


K 


L 


• 1 


1 


0 


0 


1 


0 


1 


0 


AO 


0 


- 1 


\ 


0 


. 2 


0 


0 


5 


0 


0 


0 















Subtest Statistics: 
• Maximum Possible Score; 10 
T^nge of Scores: 2-10 
Number of Students: 144 
Mean: 6 



Assessment 1 measures the stude^nts' ability to select from 
a list of twelve items the ones they could not live without. 
' Nearly 22 percent of the'Students selected all five of the most 
logical choices^, 45 percent selected four of fiv#, anid 23 percent 
selected three of five. Therefore, just under 90 percent 
selected at least three of the most logical choices compared to 
the staff-established ^standard of 80 percent. A shtiilai' 
assessment was used for Field Test I, the only difference being 
that students were asked to select j;he. choices they could live 
without. Thirty-nine percent of the students responded 
successfully to this item in Field-Test I. This difference could be 
accounted for by material revisions that took place betweer^ 
the two experimental editions. It also could be attributed to a 
rewording in the assessment itself. GeneVally this population 
of field-test students had a moTe difficult time answering a 
qy^estion expressed as a negative rather than a positive. 

5-1. ^ 

(Refer to Item 27r page 36, Formative 
Evaluation Report 2) 

HARK AN X ON EACH THING WHICH m COULD M LM WiTHOUI, 



A. 



GASOLINE 



E. AIRPLANES 



C. CWNT 



G. TV 



iQlJ 



"1 



CARS 



J. 



FRiy)()S j lK.)i^ELTE 



H. SOIL 
i L. HIGHWAYS ' 



5% Ohe-»esponse 
3% Two Responses 

23% Three Responses (air, fbod, water) 
2% Thin|0 Responses (other combinations) 
45% Four of Five Responses 
22% All Five Responses (air, foo\l, water, 
friends, shelter) 

Assessment 2 measures student understanding of a 
definition of recycling. Although 70 percent of the students 
responded successfully, that was somewhat undefr the staff- 
established standard of 75 percent. This assessment item had 
no counterpart in Field Test I that could be used for 
comparison. 



" Both assessment items in Subtest 5 evaluate student 
knowledge about concepts introduced in Unit 1 but developed 
more fully in later units.. Ninety percenf^of the students 
selected -at least three environmental corn|5pnents essential 
f6r life, and 70 percent' of tliem knew a functional defir\it4on for 
recycling. That indicates a good baseline cff understanding for 
building the next units. ... 

Unit 1, Subtest 6, "Picture Taking'' 

The one item of assessment in Subtest 6 is by no means a 
test; and could be classed more apprQ'priately. as a skill- ^ 
"development activity. A Polaroid camera was selected as an 
optional piece of equipmeht for the ME AND My ENVIRON- 
MENT curriculum. The main reasons for its sefection can be- 
sumrnarized in three points: it provides instant feedback to 
students; it^ provides another avenue for deveJopment of 
manipulative skills; and it aids in documenting portions of an 
experiment. To evaluate student success with this curricular- 
aid, the activityJabeled "Subtest 6''^ was developed. Students 
first familiarized themselves with the camera, then practiced 
different poses against selected backgrounds, 
^^tudents were evaluated oh the quality of their pictures in 
terms of focus, exposure, positioning, and stea<4iness. Rfty- 
two percent of the students were success'ful in using the 
camera, and another 32 percent had only minor problems. 
Examples of the students' work appear \n BSCS Nevi/sietter 55, 
page 26. The standard for this assessment was for66 percent 
of the students to take good pictures* or haye dniy minor 
problem^;. Student, perfohnance far exceeded "this with an 84 
percent performance. As a point of contrast, only 25 percent of 
the teachers and staff took pictures of good quality, after 
instruction by a Polaroid sales re|jresentative. 

Long-term Retention ' 

As discussed in the section on "Clues to Sucdfess," a major 
diff^rence^ between Field Test^ I and II was* the manner in 
whjch student perform a nee data was collected. For Field Test' I, 
data was collected on identical pre- and posttests, ad- 
ministered preceding and following each unit of instruction. 
For Field Test II, data was collected from "Clues to Success" 
activities incorporated in each unit and administered at* 
various intervals during instructipn. 

Because of the Field Test 'II data collection format, there 
was nQ opportunity for evaluation of the^ students' long-term 
ret^htion offisubject matter covered'in the curricular materials. 
Therefore, for this. reason and because 8SCS staffs needed 
student baseline data before commencing instrujction of Unit 
•3. "Energy Relationships in My Environment," (revised Unit 2, 
part 1 , 1971-72 first experimental edition) in ihe fallbf 1973, 
at least three months after instruction; a number of assess- 
ment items were adfninistered to students who had corf»pleted 
Unit 1. ' ' ' ^ ^ 

The above data are from the two separate groups of 
students; no attempt was made to obtain a random sample. In 
addition, though the questions administered were* identical in 
both f ielrf'test groups, instruction did vary within and between 
groups. Thus, no generalizable conclusion can be drawn as to 
the retentive ability of these students. Since the seven areas of 
retention illustrated here reflect objectives where mastery 
was called for, it did help the developers in making dec«ions 



FIGURE 2 Long Term Retention ' 

(A Minimum of Thr** Months Aftvr Instruction) 

^* * -1 f isld Ttst 11 Immoditt^iy Following Instruction 

Fisid Tott I Thr»« Months Aftor Instruction 




about further/evision. (See Figure 2 for a summary of'the 
comparisons.) ^ ' . ^ 

Five Jtems assessed student retention of the ability to> 
me^s^re accurately temperature and length. 'Students were 
assessed on their ability to read three different temperatures 
within + 2°F. IVtearly 46 percent of. the students 'were 
successful on/all three readings and 79 percent were 
successful on. two out of three readings. This compares 
favorably with ah 89 percentstudent success performance on 
identical questions used in Field Test Uthat were adnlrnistered 
immediately following Instruction. 

Students were also assessed on th^ir ability to measure 
two different length^ within %,of an inch; one was'over 1^ 
inches and the other was under 12 inches. Nea)^ly41 percent^ 



of the students were successful with the over- 1 2-inch length, 
and 42 percent were successful with the under-1 2-inch 
length, During Field Test II. 47 percent of the students were 
successful with the over-1 2-inch measurement, and 66 
percent were successful with the under-il 2-inch measure- 
ment. For this population of students, those who first 
dev^oped the ability to measure accurately over 12 inches 
were able to retain their measurement ability longer than 
.those who initially developed the ability to measure only under 
12 inches. • 

Two items assessed student retention of the ability togroup 
and classify ^objects into categories^ One item measured 
student atjility to sort and group ten pictures into two 
categories — plant^-^find animals. Ntaarly 56 percent of the 
students were successful with this compared to a 91 percent 
performance on an identical question used in Field Test II. This . 
marked drop in retention further justified the expansion of 
grouping activities in Unit 1 of the commercial edition. Another 
item measured ability of students to provide a category for ^ 
group of objects shown on a slide. Slightly over 73 percent of 
the students w^re' successful dbrnpared to a 6^ percent 
performancaon.a similar question used in Field Test II which 
was admini^ered immediately following instruction. It is 
interesting to note that although students had more difficulty 
in determining a category for a groi/p of object^ in comparison 
to placing objects in def ir\ed categories, they retained more of 
the former than of the latter. 

Five iterns assessed student retention of ability in locating 
compass directions and other spatial orientation. Two 
assessments measured student ability to determine map 
directions. Over 60 percent of the students retained this ability 
Conr^pared to an initial student success of 66 percent on 
identiq^l questions. Three more items measured student 
ability to read a map and find specific locations. Only 34 
■percent of the students were successful .on these 
assessments, while 70*' percent of the students were 
successful on these items immediately gfter instruction. This 
performance furthersubstantiated the n^efl for expansionand 
revision of those activities related to spatial orientation. ■ 



student' performance 
on iten^^ assiessing 
instrudtion in unit 3, 
"energy relationships 
in my envirotirnent/' 
field test 1 1 

Twenty-nine of the sixty-two items used In Field Test II 
directly relate to materials and instruction in Unit 3, "Energy 
Relationships in My Environment." Unit 3 materials originally 
appeared in Unit 2, part 1 of the 1971-72 first experimental 
edition. These now appear in Unit 3 of the commercial version 
in revised form. The twenty-nine items assessed materials and 
instruction presented in the twenty-five activities of the unit. 
The items fell into six categories by topic: 1) Relationship of 
Temperature, Energy, and Work; 2) Graphing and Reading a 



Graph; 3) FuH and Healthy Game; 4) Food Energy and Diet; 5) 
Food Chains and Webs; and 6) Plants and Their Source of Pood 
and Energy. As* in the analysis of Unit 1 items, it was 
considered most appropriate to examine each item in the Unit* 
3 subtests individually.' 

Results are presented with a brief discussion of each item, 
the percentage of students responding^: successfully, corrr- 
parisons to staffrestablished standards, and, when possible, to 
similar or identical items used in Field Te^l, a brief analysis, 
and explanation of revisions, expansion and/or deletions that 
took place in the commercial version as a result of student 
performance on these assessments. 

In the case of the second experimental edition of Unit 3 
(Field Test II) the students achieved at or above standard in 
twenty-six of the twenty-nine instances. Of the seven similar 
but not necessarily identical items in jhe first experimental 
edition of Unit 3 (Field Test I) only one was higher than the 
results of Field Test II. As in the case of Unit 1 this reflects 
an irnprovement in the materials ^s well as in the items 
used in the two field tests. 

Figure 3 shows a summary of. results from the use of the 
test items. 
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FIGURE 3 



A Comparison of Staff Standards of Achievement in Ur^it 3 with Actual Results in Field Tests I and It 



- Staff Standard 
-Raid Tast II 
Fiald Tast I 




Unit 3, Subtest 1, "Relationship of 
Temperature, Energy, and Work" 

Table 6 contafns a statistical summary of seven assess- 
meht .items used as Subtest 1 , "Relationship of Temperature, 
Energy, and Work." These assessments were administered as 
Activates 3-4 and 3:5 on Worksheets 3-3 and 3-4 in Core A, 
Unit 3t^"Energy Relationships in My Environment," second 
experVnental edition 1972-73. Table 6 includes item assess- 
ment objegtives,Htem scoring, and other subtest statistics. The 
maximtfei score for this subtest was tFwrty-five points, five 
points each for seven assessments. 

Assessment 1 measures student ability to predict which of 
two beakersicontaining tea bags — one with hot water and one 
with cold-^will provide tea first. Compared to the staff 
standard of acceptability of 75 percent, 94 percent of the 
students responded successfully. There was no Field Test'l 

^ TABLE 6 ^ 

Summary Information for Subtest 1 
"Temperature; Energy and Work" 
(seven items) 
This group of items assessed: 

• understanding thatenergy is the ability to dtv^ork (Items 5. 6. 7, and 

• awareness that the higher the temperature, tiMhigfter the energy 
(Items Is 2. 5. and 6) -r-^ /f 

• awa^^fless that work and temperature are directly related (Items 3, 
4/and 7) 

Subtest Weighted Scordsy 
Weights Per Option 



Item 




B 


c 


D 


1 


5 


0 






. 2 


5 


0 






3 


0 


5 






4 


0 


0 


0 


5 


5 


0 


0 


0 


5 


6 


5 


0 


0 


0 


7 


0 


5 


s 


0 



Subtest Statistics 
Maximum Possible Score: 35 
Range of Scores: 0-35 
Number of Students: 157 
Mean: 16 



assessment appropriate for comparison. 

Assessment 2 measures students' ability to defend their 
answers in assessment 1 . Results reveal that T>6 percent 
responded successfully. 23 percent responded with a weak 
defense, and 21 percent did not respond. The staff had 
established a 50 perceht student performance standard of 
acceptability. There was no Field Test I assessment ap- 
propriate for comparison. - « ' , v 
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HOT TEA 
94% 

VVhich will be ready first ? . 

3-2. 

Why 

Explanation 
of prediction: 



toLD TEA 
6% 



good 56% 
weak 23% 
none 21% 



,^ Assessment 3 measures student ability to predict which of 
tWo petri dishes contains the warmest water after watching 
the diffusion'^of a potassium permanganate crystal in both 
dishes. l5ata shows that 77 percent of the students responded 
successfully; 14 percent were unsuccessful, and 9t3ercentdid 
not respond. The staff standard of acceptability vOas 66 
percent. About half of the students were successful on a 
comparable assessment in Field Test I. ' 




Prediction of temperatui^e (selection of petri dish with the 
wamnestwaterinit): 77% correct 
14% incorrect 
9% No Response 

Assessment 4 measures student ability to predict which of 
four test tubes Containing water and capped by a stopper will 
pop its stopper first under four different heating conditions. 
Compared to a 75 percent staff standard, 88 percent of the 
students responded successfully. There was no comparable 
• assessment on Field Test I for analysis. 

. Assessment 5 measures student ability todetermine'which 
tube of water has the most energy. Compared to a 66 percent 
standard of acceptability, 86 percent of the students respond- 
ed successfully. On quite a different assessment, but related to 
the same objective in Field Test 1, 85 percent of the students 
responded successfully. (See Items 18 and 19, page 37, 
Formative E valuation Report 2. ) 

Assessment 6 measures student ability todetermine which 
test tube is able to do the least amount of work. Comparedno a 
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1-4. 

WHICH OF IfiL f(!,I ruBtS OF WAILR WILL W iHt ( OHK IH( FA'.IISI'' 

H □ K '^oR«»P°"«« = ''^° 

1% 3W 7% 88% 

MARK AN X ON YOURH^JOKL 
1-5. 

WHICH UST mi OF WAUR IS RLCLlViNG IHL MOST tNLRGV 



► '8% 1% • 5% 86% 

MARK AN X ON YOUR CHOlCt. 

1-6. 

WHICH UST TUBE OF WATtR IS ADLl TO DO IH( L(ASI AMOUNI OF WORK'' 

[1] ■ m W 

40% 32% 12% 16% 

MARK 'AN X'ON YOUR CHOlCt. 



Student performance standard of 50 percent, only 40 pertent 
of the students were successful. Student performance [was 
significantly below acceptable standards. The somev^hat 
comparable assessgnent on the posttest f6r Field Test- 1 in 
which the most Amount of work was asked for had 91 percent 
of the students r'espondjng successfully. ' 

Assessment V measures student ability to predict the' 
fastest rate of diffusion between chemicals in four different 
beakers at four different tecr^p^atures. Results show that 83 
percent of the students were successful compared to a 66 
percent stgj[f standard of acceptability. A comparison with litem 
21, page 39, of Formative Evarqation Report 2 showp 50. 
percent of the students were successful in grasping the 
concept as measuren by that item. 

1-7, 

I 

" LACH BEAKER HAS THE SAME AflOUNT OF WATER, A THERMOMETER SHOWS 
THE TEMPERATURE 0^^ THE ^AltR \H EACH BEAKER. A CRYSTAL OF PUpPLE 
CHEMICAL IS UROPPtD INTO EACH*BEAKER^ | 




IN WHICH blAKfP WILL THL fURPLL CHLMRAL SPRLAD THL FASTEST? 



7% 83% 5% 

MARK AN X UN YOUR ChOK( , 



5% 



Student performance on this subtest was exceptibnal and 
in fact surprising to the staff. Some curf iculum developers felt 
that the relationships between temperature, energy, pnd work 
were too abstract for this population of students and that 
correspondingly, performance would be low. Although there 
was revision and rearrarigement, these concepts end \heir 
associatrons were deemed appropriate for EMH students and 
were included in the commercial edition. 

An interesting trend is beginning to emerge. NOte that on 
assessment 6 student performance was low This isrepresen- 
tative of many examples in this curriculum where stilidents had 
difficplty with understandings that were oppositip, to those 
emphasrzed in the activities For example, students joarn that a 
high temperature provides high energy, but they have great 
difficulty cxtendirjg^i^ concept to comprehend that a low 
temperature provides low energy It should be pointed out to 
EMH curriculum developers that both types of actlivities must 
be deveiloped before student understanding is maximized. 
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Unit 3, Subtest 2. 
Graph" 



'Graphing and Reading a 



Table 7 contains a statistical summary of eight assessment 
Items used as Subtest 2, "Graphmg and Reading a Graph." 
These assessments were.administered as Activities 3-7, 3*8, 
and 3-10 on Worksheets 3-7, 3-8, and 3-9 in Gores A and B, 
Unit 3, "Energy Relationships in My Environment," second 
experimental etJitlon 1972-73, Table 7 includes item assess- 
ment objectivBs, item scoring, and other subtest statistics. The 
maximum score for this subtest w^s forty points, five points 
each for eight, assessments. 
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TABLE 7 

Summary Information for Sub.test 2 
jjf "Graphing and Reading a Graph" 

I (eight items) 

This group of items assessed the ability to 



recognize correct graphing and interpret the graph (Items 1 . 2. and 
3) 

enter data on a graph (Item 4) 

label graph axis and enter data (Item 6) 

label graph axis, enter data, and graph results (items 6. 7, and 8) 
Subtest Weighted Scores. 
Weights Per Qption 



Item 


A 


B 


1 


0 


5 


2 • 


0 


5 


3 


0 ' 


0 


4 


5' 


0 


5 


0 


5 


^ 7 


0 

5 . 


5 
0 


8 


0 


5 



5 
0 



0' 
0 



0 
0 



Subtest Statistics 
Maximum Possible Scoise: 40 
Range of Scores ' 0-40 
Number of Students * 142 , 
Mean- 21.5 - 
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''WHAI WA*, THi IlMPlftAlUPi ON lANllAPY 
% 

WHAT WA', ]H\ TfMPfPATiJPI UN HhPUAPY 



Assessment 1 shows a graph of dates and temperatures.' 
and asks students to identify a particular temperature on a 
particular d^y! Nearly 88 percent of the students, responded 
successfully compared to an 80 percent standard of accepta- 
bility. / \ ' 

^tssessment 2 asks students a que.stior^^ similar to 
assessment 1 . except that to read the temperature accurately, 
the students must interpolate. Compared to a 50 percent 
•standard of acceptability, 60 percent of the students were 
successful. There was no comparable question on the Field 
Test I posttest. 

Assessment 3 measures student ability to perceive a trend 
or pattern in a graph oVer a period of time. Almost 83 percent of 
the students were successful compared to arv^ acceptable 
student performance standard of 70 percent. TKere was no 
comparable question on the posttest for Field Test L 

Assessment 4 measures student ability to enter a ne\A/ 
temperature on the graph. Compared to a 60 percent staff 
standard, 86 percent of the students were successful. There 
was no question for comparison on Field Test I. 




0 1 
Dec Jan 



Feb 

5 



Mar 

5 



Apr 
5 



May 

5 



June 
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July 
5 



2-3. 



I. 



83% 



8% 7% 

Write in of "They were 
different." 2% 



2 4 



' ^* 86% Correct 8% ~- Incorrect Date 

4% Incorrect Temperatuw 2% - 80th Incorrect 

J 

Assessment 6 provides the students wtth.graph axes labels 
and as^s them to record ih^ir data from the High Flyer game. In 
this 'game, students worked with the relationship between 
energy inppt and energy output when launching a checker or 
bottlocap with a rubber band Results revealed that 80 percent 
of the students completed this task successfully compared toa 
50 percent staff standard Once again, no comparable 
question was used in the Field Test I posttest 
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Rubber band stretched 
between two 
nails 6 inches apart 




Board 



Assessment 7 measures student ability to reeord and graph 
data on temperature vs. time. The data was collected frbm 
"^thermometer readings of water in a beaker under an extreme 
condition of agitation. Without teacher assistance, 66 percent 
of the students recorded and graphed this data successfully. 
Problems with recording temperature hampered 20 percent of 
the students and TS^rcent had problems with ticne. The staff 
standard for thig assessment was 50 percent. Thts question 
had no counterpart on the Field Test I posttest. 
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A^essrpent 6 measures student ability to graph the datia 
enterect,from^assessment 5 as it appeared on Worksheet 3-9. 
All of the students (100 percent) were successful compared to 
a 66 percent standard of acceptability for student perfor- 
mance. There was no comparable question on the Field Test !✓ 
posttest. In this case, it would appear that the results are not 
completely reliable, since worksheets are often completed as a 
'group activity, though such was not to be the case in this 
instance. ' ^ 
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Assessment 8 is identical to assessment 7 except that two 
additional conditions of water agitation wore introduced — mild 
and no agitation. Under these two additional conditions, 73 
percent of the students successfully recorded and graphed 
data Because of the similarity to assessment 7. the staff felt 
that 70 percent of Iho students should hovo performed 
successfully This standard was mot This assossmont hod no 
counterpart on the Field Tost I posttest 

Again, the student performance on this subtes^ pleasantly 
surprised the curriculum developers The abilities required to 
perform successfully on the sutoesi included interpretbtion. 
recording, graphing, labeling, and drawing, mahy of these 
skill's before that time had been considered beyond the abilities 
of EMH students 

One (if tKa real rewards students achieve from succ^lBs m 
'g^f^phinfl anls^LOCording i^-Uicit by these moans they con 
. communicate 'Sota. information, and understandings ac- 
curately: thoro liino need for n great dool of orol or written 
communication, whore many EMH students are woak 

Somo revision and slight reorrongement took place »n the 
commercial Edition of Unit 3. but generally the concepts 
introduced in the 1972 73 second experimental edition y^oro 
retained 
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Unit 3, Subtest 3, Full an(l Healthy Game 

^The only item assessment for Subtest 3 measures student 
ability and knowledge of health and nutrition asdeterrninedby 
their success in playing a card game related to these concepts. 
This assessment was 3dministered as Activity 3-13 on 
Workshe^et 3- 1 4 in Core B, Unit 3, "Energy Relationships In My 
Environment," second experimental edition 1972-73. 



The object of the game, which is simrlar to rummy^ is for the 
students to draw and discard food cards ujntil they make three 
meals that include certain proportions of the four food groups. 
Results reveal that 68 percent of the students grasped the 
game concepts and successfully rhet game objectives. The 
staff had established that 80 percent of the students should 
play the game successfully. Student performance was below 
that standard, but more importantly, students lost interest in 
playing, perhaps because they were bored with another card 
game based on the rummy format, or perhaps because the 
writing and computation were too difficult for them. The R.ull 
&nd Healthy game was not used in Field Test I materials; 
therefore, no comparison can be made. 

As a result of student performance and teacher fet.edback 
reports, this game was deemed too difficult and therefore has 
been omitted in the commercial edition. It was replaced by a 
puzzle game entitled Go and Grow, which stresses the same 
objectives but relies on a four-color prctorial format. The 
writing and computational skills called for in the Full and 
Healthy game are replaced by manipulation skills. 



Unit 3, Subtest 4, "Concepts of Food, 
Energy, and Diet" 

Table 8 contains a statistical summary of four assessment 
items used as Subtest 4, "Food, Egergy, and Diet " ThesQ 
assessments were administered as Activity 3-14 on 
Worksheet 3-18 in Core B, Unit 3, "Energy Relationships in My 
Envirohrrient," second experimental edition 1972-73 Table 8 
includes item assessment objectives, item scoring, and other 
subtest statistics The maxiqnum score for this subtest was 
twenty points, five for each of four ques^ons 



TABLE 8 

^ Summary Information for Subtost 4 

"Food, Enorgy ond Dioi " v 
(four Moms) 

This group oi iloms ossossod knowlodgo thot , 

• food IS tho body's source of onorgy (Itom 1 ) 

• colonos ond energy ore directly rolAted'dtems 2. 3. nnd 4) 

Subtest Weighted Scores 
Weights Per Option 



Itom 


A 


B 


c 


D 


E 


F 


Q 


1 


5 


0 


0 


0 


0 


0 


0 


2 


5 


0 


-0 


0 


0 


0 


. 0 


3 


0 


0 


5 


0 


0 


0 


0 


4 


0 


5 


0 


0 


0 


0 


0 



jf Subtost Stotisfics 

Mnximurp Ponsiblcj Score 20 
Rnnge of Scoroa 
Number of Students 163 
Moon 12 



0 



In Assessment 1 . student^ are given a short Popeye. Olive 
Oyl. Bruti^s vignette and a chart of foods with their associated 
energy in i^alories. As always, Popeye must rescue Olive Oyl. 
but his eveV-present spinach is gone and he must turn to a 
different food choice, Students are asked why he must eat 
before the resf:ue. The data shows that 79 percent responded 
successfully, ^nd 10 percent more were close to correct in 
their answers. \The staff-established standard for -student 
performance acceptability was 75 percent, On the Field Test I 
posttest, a question assessing the same understandings was 
responded to successfully by 51. percent of the students. 

Assessment 2 asks the students what food Popeye selected 
•^'for his needed "go power." Compared to a staff standard of 75 
percent, 78 percent o\ the students responded successfully. 
There was no comparable assessment on Field Test I. 
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"I nunt by quit'M,* thought J'up«»y», "or KfLitu* will t\*vm j i 

•w««t 'liw» ffyl •nd J nmy n«v»r find hnr *iiain.' »'rn»..yi. tijrnf l t' 
of •pln*chi 'My •upply »■ ijonnll" qromnfti. "Mwlj* Wh^t •hnl 

In )u«t flvm Bhort miniitva *h» will b» cjon«« fo r«> r ' ' *" .'in.k-thn 
l>op«y« lookvd 4t hl« •v«r>N«nJy r«lori«r bcxik > 



• rnnc 



Suq«r - - 

sy'up 

T-bonn atWAh- 



C«r rt»i« " •• 

•A^, h*r* It !• '»t J**J«t wh«t t n 

h« t»n to hi« 'Upt'dat'l, c]ri«i>tfO'1 > h" h t '}h 
'AilAI What onwrtrv't It" fnlt his muai lo* 
off, rvmnlnq fj»»t «■ • bullet tn r*«' 
t !■»■ • fi«aav(1 ovnr th* *t#ail of tlrutua. 

«|jt>P4fBil into ttia fllatAHiB Willi hnr 



4-1. 




(Refer to Item 9, page 38. Formative Evaluation 
Report 2) 

POPCYL WANILU 10 LAI FOOD bLFORL IRYING 10 f^l M UL ULIVI 
OYL, BLCAUU Ml KNLW FOOD CONIAINS 

= Energy 10% = Calories 
9% ^ther 2% = No Response 

4-2. WHICH. FOOD ON iHf ULORii ChAPI 
MO' I -1,0 POwli'"^ 

78% = Steak 4% = Peanuts 2% = Beans 
2% = Sugar 1 3% = Other 

Assessment 3 asks why their selection m assessment 2 
had'the most "go power " Compared to a staff standard of 75 
percent. 90 percent of the students responded successfully. 
There was no comparable question on Field Test I. 

4-3. WHY jID you '.ay THr> fOOt MA', IhL M(JM "bd ('(jWLf^ ^ 
6%[ A. HlfAU>( I UkI II. I 



2% r . hi( Aii',( II loM'. my\ . 



90 



1%[ j, M'.AuM IMI I , )f : I . I 



Assessment 4*measure3i st udent ability to determine which 
food on the chart Popeye would have to eat the most of to get 
the same amount of energy as in their selection of assessment 
2, Only 45 percent of the students responded successfully 
compared to a st^ff standard of 50 percent. There was no 
comparable assessmen^^n Field Test I, Again we see student 
difficulty in handling concepts opposite from those emphasiz- 
ed. in the activities. 



4-4. WHICH WOULD YOU HAVE 10 LAI IHL MOSI OF TO TmL 
SAME /\M0UNI OF CNERGY? / 



12%[^A. B 



BAKLD BCANS 



45% 



33%| C. STLAK 

HARK AN X ON YOUR CHOICE 



f, ORANGES ^ 
^ 8%[^D. bR[AD J 



Generally, student performance on this subtest was 
acceptable^^Some revision took place to eliminate student 
confusion between energy, "go power." and quick epergy , The 
Popeye story was revised for just that reason. Additional 
activities were added and others expanded to reinforce further 
the relationship between food, calories, energy, and work. 



Unit 3, Subtest 5, "Food Chains and Webs" 

Table 9 contains a statistical summary o^ four assessment 
items used as Subtest 5. 'Food Chains and Webs." These 
a'ssessments were administered as Activity 3-19 in Core C. 
Unit 3. "Energy Relationships in My Environment." second 
experimental edition 1972-73. Table 9 includes item assess- 
ment objectives, item scoring, and oth^r subtest statistics, The 
maximum score for this subtest was twenty-one points, five 
points each for assessments 1. 3. and 5. and six points for 
assessment 2. 



TABLE 9 

Summary Information for Subtest 5 
"Food Chains and Webs - 
(four Items) 
This group of items assessed ability to 

• dotermino the in^Grdepondonce betwoon plants an^animals in a 
food web (Items 1 . 2) ' '""'^ 

identify the appropriate links m a food chain (Item 3)* 

• develop a food web (IterVi 4) 

Subtest Weighted Scores . ' ^. 
jL Weights Per Option 
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' Subtest Statistics 
Maximum Possible Score 21 
Range of Scores 0-21 
Number of Students 147 
Mean 11 
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Aisesfiment 1 measures s*tud^t knowledge .of the^ 
interdependence of animals and plants in a food web. Students 
using flashcards connected with string were asked the results 
of removing a particular plant or animal from a fqpd web. 
Compared to a staff standard of 80 percent, 84 percent of the 
students responded successfully. There was no comparable 
question on the Field Test I posttest. 

Assessment 2 measures student knowledge of what might 
happen to the food web now that something has been 
removed. The fact that some animals would stanve and die was 
indicated by 26 percent of the students; 25 percent did not 
respond to the question; 6 percent indicated organisms would 
-decrease; 8 percent indicated organisms would increase;- 9 
percent said that the animals would move someplace else; and 
25 percent answered two or more of the above. The staff hdcf 
established a student performance acceptability standard of 
.75 percent with at least one correct response. This standard 
'was met. There was no assessment for comparison in Field 
Test I. 

Assessment 3 asks students to connect pictures in a food 
chain, starting with'a boy who is eating an egg for breakfast. 
Resufts show that 74 percent of the students completed this 
task successfully, compared to a 66 percent staff standard. 
This same question X>n the Field Test I posttest revealed that 49 
percent of thlB. students responded successfully \n the 
commercial revision the further distinction is made between a 
food source chain and a typical food or energy chain. 



5-3. (Refer to Item 6, page 39, Formative Evaluation 
Report 2) 

A BOY AIL- AN tOG FOR BRLA-RFASl. IjRAW APHUW. KflWKN 1H[ fMdUPi;. 
*PlCIU^iFS K(LOW 10 '.HOW IHI RIM Or IH[ FOnlJ CHAIN. 




BACON 

BARN 




Assessment 4 provides a worksheet with six anjmal and 
plantVct J-es and asks students to develop a food web. Five 
associations were made by 44 percent of the students, 46 
percent made three or four associations, 5 percent mad§ two 
or fewer, and 5 percent miade more than five associations. The 
staff had established that 80 percent of the students should 
make three or more associations. This standard was met by 90 
percent of the students. There vyas no comparable question in 
Field Test 4. ' , ^ 



5v4. 

MAKE A FOOD WEB BY DRAWING ARROW? TO POINT TO WHERE EACH THING 
GETS ITS FOOD ENERGY. 




BIRD SNAKI 



There was some revision .and rearrangement of activities 
related to thfis subtest, but generally they were considered 
appropriate and successful with EMH students. 

TABLE 10 

Summary Information for Subtest 6 
"Plants and Their Source of Food" 
(five Items) 
This group of items assessed knowledge 

• that plants make their own food {Items 1 , 2, 3. and 4) 

• about the need for an anrmal dependence upon plants (Item 51" 

Subtest Weighted Scores 
Weights Per Optrt>n 
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Subtest Statistics 
Maximum Possible Score 26 
Range of Scores 0-26 
Number of Students 163 
Mean 14 



Unit 3, Subtest 6, "Plants and Their Source 
of Food and Energy" 

Table 1 0 contains a statistical summary of five assessment 
items administered verbally without penc/Lor paper and used 
as Subtest 6. "Plant^and Their Source of Food and Energy " 
These assessments were administaactivities 3-24 and 3-2re) 
D, Unit 3, "Energy Relationships in My Environment," second 
experimental edition 1972-73. Table 10 includes item 
assessment objectives, item scoring, and other subtest 
Statistics. The maximum score^or this subtest was twenty-six 
paints, five points for assessments 1,2.3. and 4, and six points 
for assessment 5. 

Assessment 1 .measured student knowledge of whether or 
not water i^ a plant food. Compared to a 75 percent standard, 
72 percent of the students responded successfully. There was 
nocomparabljp question in the Field TesjlJ posttest for analysis. 

Assessment 2 measured student knowledge of whether or 
not light is a plant food. Compared to a 75 percent standard, 83 
percent of the students responded correctly. There was no 
comparable question in the Field Test I posttest for analysis. 

Assessment 3 measured student knowledge of whether oir 
nof air is a plant food. Re$ult^ show that 93 percent of the 
students respond6d correctly coml^ared to a 75 percent 



standard. There was no question for comparison on the Field 
Test I posttest. x 

.Assessment 4 measured student knowledge of whether or 
not soil is a pj^pt food. The data reveal that 76^|j^rcertt of the 
students' responded correctly, compared to % 75 percent 
standard. There was no question for comparison on the Field 
Test I posttest. 

Assessment 5 from Activity 3-25 measured student ability 
to check the^correct staterments about plants from a list of ten. 
All six correpf^lresponses v\/ere selected by 4V^ercent of the 
students; 3f percent selected five correct responses; 18 
percent selected four, 5 percent selected three, and 5 percent 
selected only one or more. In summary, 90 percent of the 
stfudents serfected four or more correct statements compared to 
a 75 percent standard. There was no single assessment on the 
Field Test I poa\{est that, was comparable; however, three 
assessments included identical statements useg in Activity 3- 
25. The three assessments had an average cofrect student 
percentage response of 30 percent. 

Student performance and teacher feedback on the ac- - 
tivities r&lated to this subtest were acceptable. However, 
because Unit ,3 was too long to be compleJt^d m one semester 
and because the activities represented »n Subtest 6 were 
tangential to the main themes of the unit, ihey were omitted in 
the commercial edition. They mav be included m future units. 

/ m 




Student performance 
on items assessing 
instruction in^unit 2, 
"me as a habitat/', 
field tests I and II 

^even of the sixty-two items used in Field Test II directly 
related to materials and instruction in Unit 2, which was 
revised from Unit 2^ part 2, 1971 -72 first experimental edition 
On tjje basis of findings from Unit 1 . Uniti2 was revised pr/or to 
Field Test I rather than after, and therefore Field^tosts I and II 
were evaluations of the same materials, using the same 
subtests. Field Test I preceded Field Test II by about four 
months. Because of this, data for t he two field tests was pooled 
as one, nearly doubling the population size , F-or obvious 
reasons, student performance on the assessments was 
compared*exclusively to staff-developed standards rather than 
comparisons between the two field tests The eleven items 
assessed materials and insjruction presented in the nineteen 
activities of the unit, and the items fell into )our categories by 
topic 1 ) Microbe Needs. 2) Pictures and Drawings of Microbes. 
3) Microbe Fighters and Venereal Disease, 4) Poster on Drugs 
As in the analysis of Unit 1 and34tems, it was considered most 
appropriate to examin£>''^ach item m Unit 2 subtests 
individually ^ 



Resuits are presented with a brief discussion of each item, 
percentage of students responding successfully, comparisons 
to staff-established standards. 'a brief analysis, and explaha- 
tidi^f revisions, expansions, and/or deletions that took place 
In tne commercial version as a result of sludent performance/* 
on these assessments. ^ ^ 

Staff standards set for each of the items assessing the 
niaterials and instruction . were exceeded in all but one 
inst|[n€e. Since there was no revision between the two field ^ 
tests the QCtual results are a reflection^Of the pooling of both 
groups. A summary of the results follows. (See Figure 4.) 
FIGURE 4- 

A t^mpurison of Staff Stondi&rdi of Achiovomont in Unit 2 with 
Actual Results In Fiold Tosti 1 onU II Combinod 

> Smfl Standard 
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Mawmum Possible Score 
Bongo of Scores 0-1B 
Number of Students 292 
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responses. The staff had jBStablished the standard that 75 
percent of the students should select at least one* correct 
choice amd 50 percent ghould select b^th. The performance 
results were slightly below those standards. Because there 
was no revision between Field Tests I and II. and therefore no 
difference between the curricular materials, data was pooled 
rather than compared. 



1-1. 



WHY DO MICROBES LlKF YOU'' 



Unit 2, Subtest TT^'IMlcro^ Needs" 



Table 1 1 contains a statistical nummary of three assess- 
ment items used as Subtest 1. I'Microbe Needs." Theso 
assessments were administered d^Activity 2-8 or) Wprksheet 
2-3 in Core A. Unit 2. experimenrpl editions 1971-72 and 
1972-73. The maximum score for this s&btesv was fifteen 
points, five points for each assessment with partial credit of 
three points for each item. 

' ~ . TABLE 1] 

Summary Information for Subtest 1 
, "Microbe Npeds " 
(three items) 

This group of Items oSsessod knowledge of the rolotionship between 
microbes end 

• men os on environment (Items 1 ohd 3) 

• microbe fighters (Hems 2 nnd 3) 

Subtest Weighted Scores 
Weights Per Option 



Assessment 1 asks why microbes like you. The data reveals 
that 30 percent of the students Selected both correct 
responses. 44 percent mora, selected one of the correct 



7% 
54% 



A. YOU ARE BIG&ER'THAN TlUY ARf . 



y, YOU &IV[ TH[M WARMTH in GROW. 



4% C. YOU HAV[ GOOD GROOM lliO MAhllS. 



50% 



j)( .YOU PROVIDL TH(M WltH A SOlJRCf OF FOOD AND HATfP.] 



MARK AH X ON TMl IMPORTANI k|A,(iN'. 



1-2 





hrtlH Of iMf'.i hOlKl'- (»AVI A'.AP IN hi(»« imMII! I mA Hi ^'hMOH 

GRUHlNIi IN II. liOflLl HA', U^^O^lUi, IN.Kf wnAI 'MuMI 

[XPLAIN IHIM rs 

11%[ A. HiCROfil S 'f Ul fRO/^ IM( A|P IHIP HOIIU ; 



2% 



li. IMI MHROBtS iMAPilJ fwm fioni! 1 



55% c. u\\ AGAR-frj liniiK was npi hoinr 



37% D, A MICROBF FIGHTfR WAS PUT IN BOItU 1 j 
MARK AH X OH YOUR IHOICIS. 

, Assessment 2 asks students for possible explanations of 
why one fla^k h^s microbes and the ofher does not, Both 
correct choices were selected by 26 percent of the students, 
and 40 percent more selected at least one correct choice. The 
staff established the standards that 50 percent of the students 
should select on^ correct choice and 25 percent should select 
both choices. Student performance oxcoodod both standards. 

Assessment 3 is a rating activity to determine how wdll 
^tucfents can make a poster on one of twq themes. "How to 
Control Microbes" or "Places That Microbes Live " At least 
three microbe controllers or microbe habitats were included by 
80 percent of the students, the staff-established acceptable 
standard was for 75 percent of the students to include at least 
three microbe controllers or habitats. 

Many of the activities relating to this subtest had major 
revision or were dropped. Thid was done in accordance with a 
shift in^^mphasis from theoretical inquiry to more practical 
application about microbe fighters and microbe habitats. Two 
prime reasons for the emphasis shift were difficulties in 
developing meaningful controlled experimental laboratory 
conditions and further attempts to make the activities mora 
relevant in terms of helping the students solve their own 
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persistant lifO problems. It is interesting to note that with the 
EMH students in this project, when laboratory results were 
clear and differentiated compared to less dranrratic results, 
student learnifig and retention were extremely high. 

Unit 2, Subtest 2. '/Pictures and Drawings of 
Micrdbes'^ ' 

Table 1 2 contains a statistical summary of two assessment 
items used as Subtest 2, "Microbe Pictures and Drawings. " 
These assessments were administered as Activity 2-3 and 
Worksheet 2-1 in Core A, Unit 2, of the experimental editions. 
' Table 12 includes item assessment objectives, item scoring, 
and other subtest statistics. The maximum scOre for this 
subtest was ten points, five points for each assessment. 

TABLE 12 

Summary Information for Subtest 2 
"Microbes— Pictures and Drawings" # 
(two Items) 
This group of items assessed ability to 

• take pictures of microbe colonies (Item 1) 

# draw accurately microbe colonips (Item 2) 

Subtest Weighted Scores 
• Weights Per Option • 
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Maximum Possible Score 10 
Range of Scores 0-10 



Subtest Statistics 



Number of Students 
Moan 7.66 



271 



. - TABLE 13 

Summary Informiilon for Subtest 3 ^ 
"Microbe Fighters and Veriereal Disease'* 
(five items^ 
This group of items assessed: 

• abilitylo collect and record data (Item 1) * ' 

• ability to discern the degree of effectiveness of different microbe 
fighters (Item 2) 

• knowledge about what to do for treatment of venereal disetise (Item 
3) ^ 

• knovi^ledge about whfch materials are microbe fighters (Item 4) 

• knowledge about facts concerning venereal disease (Item 5) 

Subtest Weighted Scores 

Weights Peit Option / 
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Subtest Statistics 
MDximum Possible S'c6r« 24 • 
Range of Scores 0-24 
Mumber of Students 263 * 
Moa/i 14.2 



and oth"er subtest objectives. The maximum score, for this 
subtest AA/as twenty-fouf points for assessment 5. 

- Assessment 1 is concerned with whether or not students 
could collect and record their own data, comparing soap and 
water to other microbe fighters. Resufts indicated that 76 
percent of » the students were hmi^ce ssful wi thout teacher 
assistance. The remaining 24 percentrequirecTfeacher help 
The project staff standard of acceptable student perfdrmanco 
was 75 percent. Student performance rnet this standard. 



Assessment 1 measures student ability to photograph 
(Polaroid) a colony of microbes grown in class. Students were 
evaluated as successful if their pictures were in fpcus, 
adequately exposed, and centered well. The staff standard of ^ 
acceptability was 66 percent, with 90 percent of the students 
successful. In a similar picture-taking activity in Field Test 11 
Unit 1 , 84 percent of the students were successful See Unit 1 , 
Subtest 6 for further details relating to camera use ^ 

Assessment 2 measures student ability to draw pictures of 
their microbe colonies, noting shape,. size, color, and pa<tern 
growth. Compared to a 66 percent standard of accoptabihtyon 
this activity, 74 percent of the students performed 
successfully. 

Taking into account that many of those students had 
manipulatrvo motor diificuliios as well as poor oyo-hand 
coordination, the results were remarkable As a result ol the 
students' performances, this typo of acilviiy was expanded, 
additional apparatus, such as a microscope and stereo glasses, 
was added to the equipment list for the commercial edition 



Unit 2, Subtest 3, "Microbe Fighters and 
Venereal Disease" 

Table 1 3 contains a statistical summary of five assessment 
items used as Subtest 3. "Microbe Fighters and Venereal 
Disease " These ogsessmpnis wore administered as Aciiviiios 
2-1 1 and 2-14 on^llysheei 2-5 and Worksheet 2-6 in Core B. 
Unit 2. of both experimental editions 1971-72 and 1972 73 
Table 13 includes item assessment objectives, item scoring, 




(Body spot) 



Microbe lightor 



(Body spot) 



Mic fobO fifjhicr 




(B(4ly spcol) 



Mi( robp hghlpf 



Assessme^ 2. a task activity, measures student ability to 
compare soap and water with a commercial microbe fighter 
and determine which one is more effective »n reducing a 
microbe colony Siudenic -were assessed on their ability to 
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discern. The data reveals that 78 percent of the students were 
accurate in their judgments, 16 percent had difficulty, and 6 
percent were unable to make a decision. The staff determined 
that as a minimum $0 percent of the students should be 
accurate in theilr judgments ^nd a total of 75 percent should be 
accurate or have only minor difficulty. Student performance 
exceeded these standards. 

Assessment 3 shows scenes of four actions and asks 
students which action they should take if they think they have 
venereal disease. Results showthat 96 percent olf the students 
were successful in their response. The standard of acceptabili- 
ty for this question was 80 percent. Student performance 
exceeded the standard. ^ . 

3-3. WHAT SHOULD YOU DO IF YOU THiNK YOU HAVE VD? 
^ ■ MARK AN X ON THE ONE YOU CHOOSE. 



3-5. DO YOU AGREE OR DISAGREE WITH THE FOLLOWING STATEMENTS: 





Assessment 4 shows six pictures and asks students to 
select the microbe fighters. All five of the* fighters were 
selected by 47 percent of the students; 24 percent selected 
four of tbe fiyp; 14 percent selected three;^ percent selected 
twoj and 5 perCent marked only one. The standard of 
acceptability was for 80 percent of the students to mark three 
or more. Student perform a nee exceejded this standard, with 85^ 

X 



percent scoring three or. more. 



3-4. 



WHICH ITEMS B^OH HELP YOU FIGHT MICROBES? 
MARK AN X ON THE ONES YOU CHOOSE. 





A 



Assessment 5 lists eight statements about venereal 
disease and asksjhe students to check whether they agree or 
. disagree with each statement. All four correct responses were 
selected by 44 percent of the students; 33 percent selected 
three out of four; 9 percent selected two; and 5 percent 
selected only one correct response. The staff had determined 
that 66 percent of the students should select three or more 
correct statements. Student performance exceeded this 
standard by 1 1 percent.^ 
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VD CAN BE CURED. * 
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YOU CAN GET VD FROM TOILET SEATS. 
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VD IS AGAINST THE LAW, 
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YOU GET VD FROM SICK DOGS. 
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VD I^ CAUSED/BY CERTAIN KINDS 
OF MICROBES./ 


X 




luu i,Hn UL 1 vu uniLi rKun ouriLUht 
WHO HAS IT. 
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YOU CAN GET VD FROM SEXUAL 
INTERCOURSE. 




— ? 

X 


YOU SHOULDN'T TELL ANYONE IF YOU 
HAVE VD. 



Student performance and teacher-student feedback on this 
s^ubtest was good and therefore only minor revision and 
rearrangement took place in these activities ir^pr^paration for 
the commercial edition. The student success was attributed to 
the inherent interest value of personal hygiene and sex 
education. The materials include a concise, frank venereal 
disease booklet that students take hOme to discuss with their 
families. 

Most of the revision that took place was an expansion and 
redrafting of the worksheets to make them more clear to 
students. Some part§ of the activities that included food 
spoilage were moved to Unit 4. 'Transfer and Cycling of 
Materials in My Environment." which deals with recycling. 
Some activities concerning microbes were dropped because it 
was believed they were inappropriate and often required a 
more sophisticated presentation >than the curriculum 
developers felt appropriate for this student population. 

Unit 2, Subtest 4/ "Poster on Drugs" 

This one assessment subtest was administered as Activity 
2-19 on Tallysheet 2-7 in Core C. Unit 2, both'experimental 
editions 1971-72 and 1972-73. Students were evaluated on 
their ability to construct a poster concerning a theme that 
would discourage friends frorf miitfusing drugs. Of the 
students. 90 percent constructed a poster and 85 perdent 
selected a theme and related their poster to that theme. ThS 
staff had determined that 80 percent of the students should be 
able to construct a poster and 66 percent should be able to 
select an appropriate theme and relate their poster to that 
theme. Student performance exceeded these standards. For 
additional poster construction comparisons, see assessment 3 
' of Unit 1. Subtest 1, "Environmental Comparisons." 

Student interest and performance was so high inactivities' 
related to this subtest that they were expanded in the 
commercial edition to include alcohol as a drug »nd the slide 
presentation in Activity 2-1 8 was converted to a filmstrip and 
booklet entitled, "Drugs: Use and Misuse." 

Throughout Unit 2. Piagetian cognitive development tasks 
vyere added' to the "CluBS to Success" activities in the 
commercial edition to be used as baseline data for comparing 
student performance in Unit 2 to performance in the previous 
as well as later units. ' ■ 
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the case 
history of 

a revision 

■ I? 

technique 




The question is often asked, "How is a new and different 
Idea^tested before it's included in a curricuium?" An eaucated 
intuition and a knowledge of the population based on past 
experiehceand research serves as an initial input. Often that Is 
all there is to go on prior to the field test, when materials are 
still in the formative stage. Sometimes, however, the idea is so 
unusual that there is no comparable precedent for it. Then a 
small-scale pilot test is in order, even pri^rto large-scale field- 
testing. Those who participate in a large-scale field test do so 
with the realization that the materials are less than perfect. 
Even so, every attempt should be made by the developers to 
'anticipate and solve problems before they occur. .Thus a small- 
scale field test using just nnp class or several typical students 
often proves valuable. , 

A case in point involved f he inclusion of c^rt^in activities in 
the commercial edition of Unit 2, "Me as an ^nvi'ronment," 
where EMH students use a pair of "stereoglasses" in viewing 
a set of paired pictures taken with a stereoscopic camera. 
Though the use of stereograms and viewers had been tested 
successfully wjth normal high school biology students, to our 



xjcrtowledge they had never bee rT introduced as part of the 
curriculum for junior high school EMH studer^ts. Yet the 
medium was believed to be an ideal vehicle for reintroducing 
the students to techniques of observation, description, and 
comparing, as welJ as the ordering of objects in a picture from 
closest to farthest. This is similar to a filmstrip activity, "Zoom 
In..., Zoom Out," use'd in the last porticr. of Unit 1 , "Exploring 
My Environment." 

In the usual sequence of teaching. Unit 2 follows Unit 1, 
with a summer break. in between. Because of the break, a 
recapitulation of majo^" ideas and techniques was believed to 
be in order before students embark upon the new unit. It was 
also believed desirable that built-in redundancy of ideas be 
incorporated, utilizing a different medium in order to avoid 
mere repetition. 

As a baseline from which to judge the EMH class 
undergoing tt^e small-scale field test, data was used that had 
been collected from normal biology classes where the new 
BSCS stereogram program was being tested. The BSCS 

. consultant directing that program accompanied the EMH 
project director. ' 
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What follows is a summary of the visit to a local class. 

Purpose: * 
To determine whether this class of EMH students could use 
a pair of "stereoglasses" in viewing a set of paired pictures. 

Criteria of success: 

1. Statements; given by the students that indicated the 
pictures viewed appeared to be in three dimensions. 

2. Student enthusiasm over the task as indicated by 
actions ^ class a,nd requests to take the pictures and 
glasses home to show their families. 

3. Student on-task behavior. 

4. Subjective comparison of this EMH class with "normal" 
classes in t<he ease or difficulty of bringing the picture into 
focus, in enthusiasm, and in on-task behavior. 

Setting: 

The "science classroom" for this class. 

Choice of material: 

The card set "Unseen Life," a part of the BSCS experimen-* 
tal stereogram program. Biology in Three Dimensions, was 
used for the following reasons: 

1 . Of all the s^ in the program it allowed for the least 
amount of structure in use 

2. It could be related to the materiaJ being studied by the 
class, and equipment already set up in the classroom could 
be used. 

8. It related cnost closely to the subject matter that would 
most likely loused in the commercial edition of Unit 2. 
4. It lent itself to the greatest amount of aesthetic 
appreciation among the students, 
v 5. It was the easiest of all the sets in the program for EMH 
students to understand. - - 

Context within which the a^^ivlty was usecf: 

The two observers introduced themselves and asked the 
^tudents to introduce themselves to the observers. The 
observers made reference to the filtration plant set-up in 

^ the room, asked the youngsters what it was, how it worked, 
and what they fourpd out from its use. To the student 
response that "It [the plant] cleared up water of mud and 
things we couldn't see," the observers stated that some of^ 
these things too small to see were similar to those pictu^ 
in the card set. ^ 

Introduction: 

Pairs of students (there were fourteen students present) 
were handed a set of the cards and asked to look at them 
and ask any questions or make any observations they 
wanted to. Within a couple of minuties many had asked, 
"Why are two pictures of the same thing next to each 
other?" To find the answer to this question, the students 
were asked to hold pencils at eye level in front of them and 
to cover one eye with the free hand. Then, without moving 
the pencil, to open the eye and close and cover the other 
eye. "What did you notice?" Most gave an answer to the 
effect that "It [the pencil] moved," Look at it with both eyes 
open, "It wasn't flat," The idea of stereo vision was 
discussed, and how two pictures viewed through 
stereoglasses could "fuse. ' ^ ^ 



Use: 



The students were aslced to take thif glasses out of the 
cases and to use them (lookthroug^lh^m) in any way they 



wanted. After a couple of minutes, they were asked to tell 
what they noticed. 

Examples of statements made by the students: 

1 . They act as a magnifying glass. 

2. They have two lenses (sides, eye pieces). ' 
; 3. They can be moved, together or apart. 

4. They can stand up (in reference to the metal frames). 

5. They can be moved so the two pictures become -one. 
Instruction was then given on how to place each lens over 
more or-*ess the same spot of each of the two pictures and 
move them together or apart as one would a pair of 
binoculars. From this point on the observers were sure that 
within ten mir\utes all but two of the students were able to 
use the glasses. The students then looked at a stereogram 
of the spores on a bread mold. Statements made by 
individual students to the observers and to the teacher as 
they circulated among them were: 

1, 'They are floating off the paper." 

2, "It looks like I could pick them up." 

3, '.They look like little donuts that I could stick my finger 
through," 

4, 'The^ look more real." 

5, "There are things sticking up at me," 

6, "Some things are closer than others." 

7, "It looks like 3-D." 

8, "Now it looks like a wheat (gra-in)." 

9, "Hey, there really is only one." 

10, "You're rigtit, it really does." 

11, "Wow, that's neat," " 
'l 2. "All of a sudden it jumpedoup at " 

Enthusiasm: 

Excittement and enthusiasm were expressed by all. One 
student had a broken glass and two tears rolled down his 
cheeks. He was noticeably rjSlieved and happy when given a 
new glass. The little girl with an extreme speech impedi- 
ment showed interest but no enthusiasm until she asked if 
shtf could take the cards and glasses home to show her 
family. ^ '\ ' 

The class as a whole seemed to show more enthusiasm 
than the normal classes. The youngsters as a whole 
seemed to manage the use of the glasses more rapidly than 
did those in the normal classes. 

Three of the youngsters wanted to take a set of glasses and 
cards home that night. This was Somewhat disappointing 
until all but one said they wanted to wait until the next 
night, Friday, so they could keep them all weekend. 

Conclusion: 

It is acknowledged that the sample size was small, and that 
there is possibte influence of the halo effect, I he above 
experience would tend to indicate that typical EMH 
youngsters have no more difficulty in using stereoglasses 
and cards than those in normal classes and show as much 
enthusiasm as do others. Because this medium provides 
still another form of variety in instruction, and in fact is the 
most 'efficient and suitable way of presenting certain 
materials, besides its rc!Gtively modest cost ($ 1 .95 per pair 
of glasses and about 10C per card), it can be a positive 
' attribute to ME AND MY ENVIRONMENT. It will be used in 
two activities near the beginning and one in the middle of 
the commercial edition of Unit 2, It will be used in 
subsequent units as the opportunity presents itself. ■ 
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a survey of EMH 
students oh 
smoking, drinking, 
and drugs 



Using tobacco, alcohol, and unprescribed drugs is a major 
part of the subjegt matter in Unit 2 of ME AND MY 
ENVIRONMENT. The placement of this material in that 
particular sequence of the currfculum was a tentative choice, 
to be tested later in order to determine. If pos^le, how 
relevant such material is^ the 1 3-yeBr-old EMH stiwents for 
whom it is primarily intended. \ 

Late in 1 972, during the first field test (FT I) of ME AND MY 
ENVIRONMENT, the questionnaire shown here was sent out 
to test classes for administration to the students before 
beginning their work on Unit 2. The same questionnaire was 
administered after the students conipletpH the unit. In the 
second field test (FT W). the same procedure was followed. 
I 
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A summary of the students' answers to the questionnaire was 
prepared for the information of the staff, program developers, 
pnd advisory committee members. The following excerpts 
from one pretest summary are presented here in the belief that 
the extent to which alcohol, drugs, and tobacco are used 
among this sampling of 13- to-, 1 6-year-olds is of general 
interest. The attitudes of these students toward the use of 
alcohol, drugs, and tobacco did not change significantly after 
their introduction to Unit 2 of ME AND MY ENVIRONMENT. 
Data supporting this concfusron is available to anyone who 
* might be Interested, but is not included here because of space 
limitations. 



A summary of student answers to the 
questionnaire about smoking, drinking, and 
drugs 

Field Test II: Pretest 

A questionnaire about smoking, drinkinjg, and drugs was 
administered to 13- to 16-year-old EMH students to obtain 
Information about the population regarding their attitudes and 
contact with smoking, drinking, and drugs. In addition, it was 
used to determine the appropriateness and direction of the ME 
AND MY ENVIRONMENT curriculum, which includes those 
topics in its content. The same questions were asked as a 
posttest to determine whether student responses change after 
instruction. 

The questions were arranged in order of least to most 
personal and potentially threatening to students. The first 
three questions ask students to respond "yes" or "no" to 
whether people their age should smoke tobacco, drink 
alcoholic beverages, and use drugs not prescribed by a doctor. 
The second three questions (4-6) ask the students to rate their 
friends on the same three topics, using a scale of never, 
sometimes, often. The final three questions (7-9), which 
students would probably foel most threatened to respond 
honestly to, deal with whetheriDr not they personally indulge in 
any of the three, on a scale of never, sometimes, often. 

Responses to the questionnaire were received from 235 
students in 1 7 classes participating in their initial year of field- 
testing ME AND MY ENVIRONMENT (FT II). The analysis 
includes a breakdown by class based on the ages of most of the 
students in the class; mostly under age 1 3, mostly age 1 3, or 
mostly over age 13. 

The analysis of the results of this pretest deals with a brief 
discussion of the results and tentative conclusions: 
I. Should people your age 

(1 ) smoke tobacco 

(2) drink alcoholic beverages 

(j) use drugs not prescribed by a doctor? 

Most of the students m all classes responded that people their 
age should not smoke tobacco (90%), should not drink 
alcoholic beverages (84%), and should not use unprescribed 
drugs (96%). 

This data indicates that students generally realize that 
smoking, orinking, and drugs diu not appropriate for people 
their age. However, the number of students who feel that 
alcohol IS appropriate for people their age is noticeably higher 
than for smoking and drugs (refer to Table 14). Unfortunately 
the context of alcohol usage was not cbtsmed in the 
questionnaire (i.e., at home» at HSrtiss, in the local es- 
tablishments). 

These figures are highly comparable with results from Field 
Test I; there is very little difference, as^'shown in Table 14. 

A comparison of negative responses by percent between 
Field TestJ and Field Test tl is shown in Table 14 for the first 
three items of the pretest questionnaire. 

TABLE 14 Negaitve (no) Responses (by %) for Students on Pretest 
Items 1-3, FT I and FT II 
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People Your Age: 


FT 1 


FT II 


(1 ) Tobacco 


87 


90 


(21 Alcohol 


84 


84 


(3| Drugs 


94 


96 : 


30 







27 



II. Do any of your friends * 

(4) smoke tobacco 
" (5) drink alcoholic beverages 
(6) use drugs not prescribed by a doctor? 

Responses show a large discrepancy between what studehts 
believe "people their age" shoul!^doand what "their friends" 
do (refer to Table 15). Fifty-three percent reported that their 
friends SMOKE TOBACCO "sometimes ' or "often" in contrast 
with 90 percent who thought people their age should NOT 
smoke. Forty-four percent repohed that their friends DRINK 
ALCOHOL "sometimes" or "often" in coVitrast with 84 percent 
who thought people their age shouldT NOT drink alcohol, 
tighteen percent reported that their friends USE DRUGS 
"sometimes" or "often" in contrast with 96 percent who 
thought people their age should NOT use drugs. 

These figuresar6 highly comparable with results from Field 
Test I; there is very little difference between the groCips. as 
shown in Table 15. 

A comparison of negative (no) responses by percent 
between Field Tost I and Field Test II is shown in Table 1 5 for 
items 4. 5. and 6 of the pretest questionnaire. 

TABLE 15 Negative ('no) Responses (by %) for Students on Pretest 
Items 4-6. FT I and FT II 



Your Friends: 


FT 1 


FT II 


(4) Tobacco 


51 


45 


(5) Alcohol 


55 


54 


(6) Drugs 


79 


81 



III. Do you 

(7) smoke tobacco , 

(8) ' drink alcoholic beverages 

(9) use drugs not prescribed by a doctor? 

The greatest^. discrepancies in ratings occurred on the 
TOBACCO items in all three categories of questions; 90 
perc^nt believed people their age should nof use tobacco. 45 
percent reported that their friends do not usd tobacco, and 73 
percent reported that they do not use tobacco themselves. 

These figures indicate a rather important difference 
between what the students say they believe and what they 
practice, since less than 10 percent believe students their age 
should smoke while 27 percent report that they, in fact, do 
smoke. This figure (27%) may be conservative if students w^re 
reluctant to trust the anonymity of their responses; this is 
further substantiated by the much higher number of students 
who report that some of their friend(s) smoke (53% total). 
Furthermore, of their friend(s) who smoke, 24 percent report 
that these friend(s) smok© "often." 

A comparison of negative (no) responses by percent 
between Field Test I and Field Test II is shown m Table 1 6 for 
items 7, 8. and 9 of the pretest questionnaire. These figures 
show little difference between the two field-test groups and 
further substantiate tl^e results of the sample of students 
m FT I. 5 

TABLE 16 Negative (no) Responses (by %| for Students on Pretest 
Items 7-9, FT I and FT II 



You: 


FT 1 


FT II 


(7) Tobacco 


74 


73 


(8) Alcohol 


71 


70 


(9) Drugs 


90 


93 



Responses to the smoking item in relation to self tend to be 
somewhat surprising. Only 84 percent of the students UNDER 
TH^AGE OF 13 responded "no," th^y do not srjioke; 10 
percent (7 out of 6 1 ) responded that they smoke "sometimes." 
while an additional'6 percent (5 out of 61) responded thratthey 
smoke "often." Figures for classes in which students wete 
PREDOMINATELY 13 and classes in which students were, 
mostly OVER THE AGE OF 1 3 were essentially similar to each 
other, but GROSSLY DIFFERED from the "under 13" classes 
(refer to Table 1 7). Thirty-two percent^g^Jhe "mostly 13" 
classep smolce "sometimes" or "often'T 30 percent of the 

"over 13" class es smoke "sometimes" or "often." 

TABLE 17 Tobac& Responses for 3 Age Groups (Item 7). FT II 





N 


No 


Sometimes 


Often 


NR 


% 


% 


^ % 


% 


Under 13 Years 


73 


84 


10 


6 


0 ' 


Mostly 13 Years 


1 1 1 


68 


27 


5 ' 


1 


Over 13 Years 


51 


69 


14 


16 


1 



These lesponses suggest the difficulty of deciding when to 
teach information regarding decision-making for smoking. If 
the subject of smoking is taught at too young an age. students 
may not be interested or ready todeal with the information. If it 
is taught too late m the curriculum when students are older, it 
toses its value for thadecision-making process. The data from 
this item suggests that the "mostly 1 3 years" group is the most 
apr^ropnafesage. particularly from looking at the trend in the 
"often" categbfv^rom "mostly 13 years" (5%) to "over 13 
^e&Fs" (16%). WmfeHtie actual number of students in those 
categories -is small and the percentages are not significantly 
different, the trend from smoking "sometimes" to smoking 
•"often" (refer to Table 17) must nevertheless be given some 
import. It is easier for people who have just begun smoking or 
who smoke only occasionally to quit than it is for those who 
smoke often or who have established the habit. 

Since the activities on smoking remained in Unit 2 they will 
occur in the first half of the 8th grade (assuming units are 
initiated in the 7th grade and taught in sequence) Based on 
the results of this questionnaire and on the assumption that 
most students are 13 in the first half of the year, this set of 
activities was retained in Unit 1 

A bre^kdovyn of figures by age level is not particularly 
revealing for alcoholic beverages or drugs There is no 
apparent trend in greater usage as students grow older (refer 
to Tables 18 and 19), 

With alcoholic beverages, about 70 percent of the students 
reported no usage, while about 25 percent report drinking 
"sometimes" ^and 5 percent report drinkinQ "oftqn " These 
figures are fairly consistent across all three age groups as 
indicated in Table 18. Aga'm. a shortcoming of the question- 
naire is that the context for drinking is not disclosed (e.g.. in the 
home, at parties, in establishments, etc.). 

This data suggests that the students are probably in- 
terested and ready to learn information concerning alcoholic 
beverages at any of the age levels for which the curriculum is 
designed. 

1 — " 

TABLE 18 Alcohol Responses for 3 Age Groups (Item 8), FT II 





N 


Often 


Sometimes 


No 


NR 


% 


% 


% 


% 


Under 1 3 Years ^ 


73 


3 ' 


' 25 


71 


0 


Mostly 1 3 Years 


1 1 1 


6 


20 


70 


3 


Over 13 Years 


51 


4 


^ 28 


65 


2 
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Since it was felt that som^students would rate their friends 
more honestly than themselves (a cautious and self-protective 
measure), an analysis of ratings of friends by age category was 
made* and subsequently compared with self-ratings (refer to^ 
Table 1 9). It was assumed that, no matter what the age of their 
friends. Students who are aware that their friends drink need 
to be informed about the use of alcohol, since they are likely to 
be confro.nted with a decision abouUdrinking. 

The analysis showed that one-third of the students 13 
yearsold or less have friends who drink at least sometimes. For 
classes containing most students over age 1 3, over one-half of 
thd students reported having friends who drink alcoholic 
beverages at least sometimes. (refer to Table 19). 

Therefore, while few students at any age drink "often" or 
have friends who drink "oftefi." the increase of friends who 
drink "sometimes" for students over age 13 (about a 17% 
increase) suggests that the content is most Unye\y before the 
^majority of sludentsin a class are over 13, 

TABLE 19 Comparison of Alcohol Responses |by %) Between Your 
Friends (Item 5) and You (Item 8) 





N 


No 


Somotimot 


Often 


NR 


(%) 


(%) 


(%) 


(Vo) 


Friends 


You 


Friends 


You 


Friends 


You 


Friends 


You 


Under 1 3 


73 


60 


71 


32 


25 


.1 


3 


1 


0 


Mostly 1 3 


in 


56 


70 


35 


20 


8 


6 


1 


3 


Over 1 3 


61 


41 


65 


51 


28 


6 


4 


1 


. 2 



With drugs, almost all students reported no usage An 
increase in taking drugs was reported in the "sometimes" 
category by students 1 3 years and older (refer to Table 20). but 
the increase was sh^ht and does not show a trend. 

TABLE 20 Drug Responses for 3 Age Groups (Item 9), FT II 





N 


No 


Sometimes 


Often 


NR 




Vo 


% 


Vo 


% 


Under 13 Years 


73 


97 


1 


1 


0 


Mostly 13 Years 


111 


89 


11 


1 


1 


Over 13 Years 


51 


-92 


6 


0 


0 



The analysis was continued to include a breakdown by age 
categories (refer to Table 2 1 ) comparing ratings of friends with 
self-ratings of drug usage. While the analysis did not reveal 
great differences from pne age group to another, the most 
surprising figures occurred m the mostly age 13 group. Fully 
1 5 percent reported that their friends use drugs "sometimes"; 
an additional 6 percent reported that their friends use drugs 
"often." About one-fifth of the students have friends using* 
drugs compared with less than one-tenth who admit using* 
drugs themselyea. Many students have contact with people 
using some type of unprescribed drugs (caution; perhaps this 
means aspirin to some students) and consequently have drugs 
available to them from this source. 



TABLE 21 Comparison of Drug Responses (by %) Between Your 
Friends (Item 6) and You (Item 9) 





N 


No 


Sometimes 


Often 


NR 


(Vo) 


(Vo) 


(Vo) 


(%) 


Friends 


You 


Friends 


You 


Friends 


You 


Friends 


You 


Under 13 


73 


85 


97 


9 


1 


4 


1 


1 


0 


Mostly 13 


1 1 1 


77 


89 


15 


11 


6 


1 


1 


1 


Over 1 3 


51 


^84 


92 


8 


6 


8 


0 


0 


0 
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The foregoing analysis suggests few clues as to the best 
age at which students should be taught ati)out drugs. The 
tjighest concentration of students using dru^s in this sample 
occurred in the mostly ege 13 category, slo perhaps drug 
information should be taught prior to but no lai^erJhan this age. ' 



Additional Discussion | 

Besides a general system of age grouping, classes have 
been categorized for field-test purposes ^s mainly urban, 
suburban, or rural. A pattern of greater or leaser usage was not 
established, nor were any characteristic differences deter- 
mined relative to these types of settings (i.e'.. '-rban. suourban. 
rural). 

/ 

Summary and Conclusions / 

/ 

1 . Results from Field Test II further yalidate those of Field 
Test I. / 

2. Most students reported that peop/e their age should not 
smoke, drink alcoholic beverages, or u^e drugs not prescribed 
by a doctor. ^ 

3. About one-half of the students reported having friends 
who use tobacco and alcohol; about one-fifth reported having 
friends who use drugs. 

4. About one-fourth of the students self-reported the use 
of tobacco and ^ohol: less than one-tenth self-reported the 
use of drugs. » 

5. About one-third of the students in classes'composed 
mostly of students 1 3 years and older self-reported that they 
smoke The trend toward smoking "often" over age 13 
suggests that students be instructed prior to 'then regarding 
smoking The highestr Interest level would probably be in 
classes containing mostly 1 3-Vear-o1d8, 

6 Smde over half of the students in classes of over 1 3 have 
social contact with friends who use alcoholic beverages, 
students may need information regarding alcohol before 
reaching that age so thev can make decisions when confronted 
by frieiius. 

7 Although most students do not use unprescribed drugs. 
15-20 percent reported having friends who do These results 
suggest that drugs be taught in the curriculum, the evidence is 
not'^fclear-cut about the beftt age in stuaents' lives for them to 
be taught about^'drug^. but suggests prior to the "mostly age 
13" classes. ■ 
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Originally an entire report on this topic 
was planned. It has been decided, 
however, to transnnit the information 
through various journals and present 
tations of papers at relevant meetings. 
Abstracts of four such papers are 
presented below. 



functional 
abilities of 
students 



Of major interest to the curriculum development staff of ME 
AND MY ENVIRONMENT Is that group of evaluation questions 
closely related to the functional abilities of the student 
popufation. (See pages 14-26 of Formative Evaluation Report 
^/TTwo questions of most direct utility are. 

• What are appropriate and realistic educational expectations 
fpr educable mentally handicapped children, where the 
American Association on Mental Deficiency standard 
liientities their handicap as miid? « 

• What is the vajue and relevance of'the various means used 
in identifying and grouping EMH children? 

Extensive, but preliminary. Studies have been undertaken 
at the BSCS, and several publications related tothis issue have 
been written utilizing det2 obtained during the formative 
evaluation of ME AND MY ENVIRONMENT. It would be 
redundant to repeat the data and findings here. Because of 
thoir potential significance, however, four abstracts of these 
studies are includnd. 

Gray. Williom 1975. The Intogratod cognitive structures 
of EMH (Educablo Mentolly Hondicoppod) children. IrtG. 
I, Lubin. J. F. Magory. ond M. K. Poutson (Eds.). Piagetian 
theory and the helping professions, Los Angolos: University 
of Southern Colifornio. 

Attempts to measure certain concepts central to Piaget's 
theory of cognitivetJevelopment — namely, the sequence in the 
development of cognitive structures and their identity as a 
structured whole — have raised two questions: First, can the 
two conceprts be measured at all. and if so. what is the 
appropriate measurement model? And second, are the two 
Joncept^ exhibited in atypical (in this case. EMH) populations? 
^hree hundred seventy-five 1 3- to 1 Q-year-old EMH students 




were given the Cognitive Developme^/Problem Solving Tests 
(CD/PS) developed by the BSCS in 1972-74 during the 
forntative evaluaWon of ME AND MY ENVIRONMENT. Most of 
the twenty-Item written test, which was composed of twelve 
cognitive-development and eight problem-solving items, was 
a tterivation of questions used in a previous study by Gray (W. 
M. Gray. 1970. Children's performance on logically equivalent 
Piagetian tasks and written tasks. Educational Research 
Monographs, Dayton; University of Dayton. Doctoral disserta- 
tion. SUNY at Albany. 1970. Dissertation Abstracts Inter- 
national, 1970. 31. 2736A. University Microfilms No 70-23. 
450.) Sequence and structured whole were evident in 
measurable form, and an appropriate measurement model 
was found to be one that stresses logical prerequisites. In 
addition the cognitive structures of atypical subjects (EMH 
students] do exhibit the characteristic of sequence and 
structured whole. 

Groy. Williom M. 1975. An integration of Piogot ond 
criterion-roferenced moosuroment. Paper presented ot 
the onnuol meeting of Uiu Amoricon Educotionol 
Rosoorch Associotion. Woshington. D. C. April. 

Piaget's theory arid criterion-referenced measurement 
(CRM) are presented and examined. The relationship between 
the two are examined in the following areas: age assignment 
of Items; item selection and difficulty; subject variance; 
cognitive structures and an achievetnent continuum; content 
and performance; reasoning behind a response, and per- 
formance to be assessed and performance criteria. CRM holds 
promise of alleviating some of the deficient practices utilized in 
present-day testing; Piagetian theory delineates an approach 
to assessing the mental processes in a way other than the 
behavioristic approach. It is concluded that Piaget's behavior- 
referenced system would be an ideal psychological basis for 
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the construction of criterion-referenced measuremenl. 

Steele, Joe M. 19^4. The relationship of developmental 
level with science performance: a case fr»r «n alternative 
to IQ grouping of mildly retarded children? Paper 
presented at the annual meeting of the American 
Educational Research Association. Chicago, Illinois, 
April. 

Thequestion under consideration m this paper is whether it 
IS feasible to place children into special classes on the basis of 
IQ scores/ An alternative cognitive developmental method 
based on Piaget s developmental model was investigated. A 
total of 492 educable mentally retarded (EMR) students. 12-15 
years old. participated in two field tests (1 971 - 1 973) of the ME 
AND MY ENVIRONMENT program developed by the Biological 
Sciences Curriculum Study The BSCS project staff developed 
three instruments that were used in the study. They include 
Cognitive Development/ Problem Solving (CD/PS) Tests of 
Dovelopmontal Level. Teacher Ratings of Students, and 
Student Performance Measur^for Units 1 . 2. and4 The data 
was analyzed by using twerlly-eight regression analyses 
involving seventeen variables, such as the student perfor-, 
mance measure, the four CD/PS Subtests, six teacher ratings, 
test class data, and demographic variables. Results confirmed 
the hypothesis that levels of cognitive development may be 
measured without IQ scores, and that children's IQ. age, 
ethnic background, and sex did not count for significant 
variance over seven replications Implications of the study 
included the suggestion for further exploration of strategies, 
such as cognitive development grouping for more effective 
instruction. (A lengthy appendix of tables and steftistical data is 
included m the article ) ^ 

Stoolo, Joe M. 1975. A longitudinal and comparative look 
at cognith/o development In- EMH children. Paper 
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presented at the annual meeting of the American 
Educational Research A^nociation. Washington, D. C, 

March. 



A case for using the Piagetian model of cognitive 
development in determining placement and curriculum of 
EMH children was investigated during a field test of the ME 
AND MY ENVIRONfyiENT program, a threQ-year environ-- 
mental sciences program developed by the Biological Sciences 
Curriculum Study. The dimensions of rate of cognitive 
development and proportion of cognitive development at each 
level were explored, in a sample of 202 EMH children 13-16 
yearsold by using the BSCS Cognitive De\/telopment/ Problem 
So|jj/ing (CD/PS) Tests. Each item in the instrument was 
weighted according to its developmental jevel. with the iormS 
operational level iterVis receiving more weight in points than 
the concrete operational level items. The resulting proportions 
were then compar'ed to the proportions of cc^nitive 
developmental levels for 1 1 • to 1 S-year^old children m t^agular 
classes Then the students were classified at four levels of 
cognitive performance according to the number of points . 
achieved on the instrument. Results showed that during a 
twelve-month period, over half showed no change in 
developmental level, while those who made changes did not 
gam more than pne level. A high positive relationship was 
found between cognitive level and performance, while it was 
shown that IQ, age. and ethnic background accounted for none 
of the variances in performance Implications included > 
changing educational placement^nd instructional pedagogies > 
to include th0 developmental model to accommodate each 
child's level of understanding, rather than continuing to pidce 
and teach children in the traditional information-transmission 
model (Tables of statistical data* and an appendix of test 
examples are included in ^he paper ) *^ ' 
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summary 

and implications 

in brief 



Three general types of assumptions continue- to be 
reinforced during the oourse of the evaluation of the revised 
curri'julum of Units 1, 2, andJJ. First, the value of formative 
evaluation (i.e.. the systematic assessment of eachstep during 
the curriculum development process to determine the 
particular effectiveness of content, strategies, format, and 
media, and the maintenance of that feedback necessary to the 
revision and refmement of curriculum) continues to be 
demonstrated when measured in terms of specific student 
behavioral and cognitive performance objectives Examination 
of Figures /. 3, and 4 shows that of the twenty identical or very 
similar content assessments directed towards specific objec- 
tives, seventeen showed a mean increase of 28 percent more 
students answering or performing a task satisfactorily Some 
of this gam can be attributed to the refinement of those 
assessments that were changed, but most is probably du0 to 
revisions m strategies, 'media, or sequence based upon the 
formative evaluation A potentially interesting summative 
study would involve taking all three versions of a given unit in 
ME AND MYENVIRONMENTand. under controlled conditions, 
determine the effect each of the revisions had on thesttidents' 
grasp of the objectives called for 

The second implication end one that does require 
continuing study, is that related to the cognitive development 
of EMH children and its infl'jcnce not only on what the student 
can expected, to learn, but on when various types of 
problem-solving and inquiry skills can be realistically called 
for The use of IQ as a primary predictor of student success in 
this pai ticular curriculum can be seriously que^stioi loJ. as has 
been discussed in Report 2 This entire issue has been 
elaborated upon in the four papers abstracted in the previous 
section. 

Finally, there are several specific comments that should be 
made relating to student performance On several of the 
subtests of Units 1 . 2. and 3. student performance significantly 
exceeded and in other cases was sjignificantly below BSCS 
staff expectations It is believed that a brief discussion of these 
results may offer generalizable implications for other 
developers of materials for EMH students. 

With an awarenes's that many EMH students have weak 
manipulative motor skills, as well as poor eye and hand 
coordination, the BSCS staff had Iqyv expectations for student 
success in those activities requiring such skills Student 
performanc^was exceptiof^al on the most demanding of those 
activitleSr however, and m some cases exceeded the per- 
formance of normal students of comparable age Slightly Over 
89 percent 'of the students successfully handled a ther- 
mometer and accurately recorded temperatures, in a variety of 




environments, wilhin ± 2*'F. Over 84 percent of the students 
were successful in manipulating a Polaroid camera and in 
taking, good pictures, which were evaluated for focus, 
exposure, positioning, and stea^ess Nearly all of the 
students were successful in manipulating microscopes, 
stereoglasses. and triple-beam balances 

One logically ^sks why students performed manipulative 
activities more successfully in this curriculum than they had in 
previous experiences. Could it be the approach? first, the 
teacher demonstrated; , then, small groups performed the 
activity; and f^^nally, the individual Iried it alone We are not 
sure why this seemed to work, ^ux the results indicate that 
EMH students can learn rather complicated, manipulative 
skills and perform them well That most certainly suggests 
further research for those in the field of special education 

Another area of surprising student j^erformance was in 
graphing rEMH students Successfully accomplished drawing, 
labeling, recording. %and ev^n interpretation of graphs to a 
marked degree Oper 88 percent of the students successfully 
identified particular points on a graph and 86 percent entered 
new aata Over 80 percent entered all the data on labeled axes, 
nearw 70 percent did the whole graphing process, including 
labeilnQ axes; ?nd 60 percent successfully interpolated graph 
information Prior to our field-testing, some curriculum 
consultants advised that these tasks were "un-do-able" by 
EMH students Again, if this is generalizable, what an asset 
this information w.ould be to other curriculum developers for 
special education Since EMH sfiudents have difficulty with 
reading and writing, graphing dl^uld be an effective com- 
munication tool for them In cr.y event, the results warrant 
additional investigation, 

Another student behavior that appeared again and again 
was the lack of ability to extend learning in directions opposite 
frnm those developed by the curnnjiar materials EMH 
students definitely appear to dpvelop <3trong unidirectional 
patterns of learning For example, in four different activities of 
Unit 3. concept^ relating high temperature to highenergy were 
developed. On the five items of Subtest 1 , Unit 3, that assessed 
understanding of this concept, the average student per- 
formance was 86 percent successful When students were 
assessed on an extension of this concept, however, namely the 
relationship'of low temperature to low energy, less than 40 
percent of them were successful This type of response 
occurred four different times in as many subtests, If these 
results can be generalized, it appears that EMH students hav^e 
low incidental learning and an inability to break sequence 
patterns ^ > * 
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